The concept of the reward prediction error—the difference between reward obtained and reward predicted—continues to be a focal point for much theoretical and experimental work in psychology, ...cognitive science, and neuroscience. Models that rely on reward prediction errors typically assume a single learning rate for positive and negative prediction errors. However, behavioral data indicate that better-than-expected and worse-than-expected outcomes often do not have symmetric impacts on learning and decision-making. Furthermore, distinct circuits within cortico-striatal loops appear to support learning from positive and negative prediction errors, respectively. Such differential learning rates would be expected to lead to biased reward predictions and therefore suboptimal choice performance. Contrary to this intuition, we show that on static “bandit” choice tasks, differential learning rates can be adaptive. This occurs because asymmetric learning enables a better separation of learned reward probabilities. We show analytically how the optimal learning rate asymmetry depends on the reward distribution and implement a biologically plausible algorithm that adapts the balance of positive and negative learning rates from experience. These results suggest specific adaptive advantages for separate, differential learning rates in simple reinforcement learning settings and provide a novel, normative perspective on the interpretation of associated neural data.
Multiple studies have shown how dendrites enable some neurons to perform linearly non-separable computations. These works focus on cells with an extended dendritic arbor where voltage can vary ...independently, turning dendritic branches into local non-linear subunits. However, these studies leave a large fraction of the nervous system unexplored. Many neurons, e.g. granule cells, have modest dendritic trees and are electrically compact. It is impossible to decompose them into multiple independent subunits. Here, we upgraded the integrate and fire neuron to account for saturation due to interacting synapses. This artificial neuron has a unique membrane voltage and can be seen as a single layer. We present a class of linearly non-separable computations and how our neuron can perform them. We thus demonstrate that even a single layer neuron with interacting synapses has more computational capacity than without. Because all neurons have one or more layer, we show that all neurons can potentially implement linearly non-separable computations.
In theory, neurons modelled as single layer perceptrons can implement all linearly separable computations. In practice, however, these computations may require arbitrarily precise synaptic weights. ...This is a strong constraint since both biological neurons and their artificial counterparts have to cope with limited precision. Here, we explore how non-linear processing in dendrites helps overcome this constraint. We start by finding a class of computations which requires increasing precision with the number of inputs in a perceptron and show that it can be implemented without this constraint in a neuron with sub-linear dendritic subunits. Then, we complement this analytical study by a simulation of a biophysical neuron model with two passive dendrites and a soma, and show that it can implement this computation. This work demonstrates a new role of dendrites in neural computation: by distributing the computation across independent subunits, the same computation can be performed more efficiently with less precise tuning of the synaptic weights. This work not only offers new insight into the importance of dendrites for biological neurons, but also paves the way for new, more efficient architectures of artificial neuromorphic chips.
Nonlinear dendritic integration is thought to increase the computational ability of neurons. Most studies focus on how supralinear summation of excitatory synaptic responses arising from clustered ...inputs within single dendrites result in the enhancement of neuronal firing, enabling simple computations such as feature detection. Recent reports have shown that sublinear summation is also a prominent dendritic operation, extending the range of subthreshold input-output (sI/O) transformations conferred by dendrites. Like supralinear operations, sublinear dendritic operations also increase the repertoire of neuronal computations, but feature extraction requires different synaptic connectivity strategies for each of these operations. In this article we will review the experimental and theoretical findings describing the biophysical determinants of the three primary classes of dendritic operations: linear, sublinear, and supralinear. We then review a Boolean algebra-based analysis of simplified neuron models, which provides insight into how dendritic operations influence neuronal computations. We highlight how neuronal computations are critically dependent on the interplay of dendritic properties (morphology and voltage-gated channel expression), spiking threshold and distribution of synaptic inputs carrying particular sensory features. Finally, we describe how global (scattered) and local (clustered) integration strategies permit the implementation of similar classes of computations, one example being the object feature binding problem.
Filamentary and rod‐like assemblies are ubiquitous in biological systems, and single such assemblies can form one‐dimensional (1D) crystals. New, intense X‐ray sources, such as X‐ray free‐electron ...lasers, make it feasible to measure diffraction data from single 1D crystals. Such experiments would present some advantages, since cylindrical averaging of the diffraction data in conventional fiber diffraction analysis is avoided, there is coherent signal amplification relative to single‐particle imaging, and the diffraction data are oversampled compared with those from a 3D crystal so that the phase problem is better determined than for a 3D crystal Millane (2017). Acta Cryst. A73, 140–150. Phasing of 1D crystal diffraction data is examined, by simulation, using an iterative projection algorithm. Ab initio phasing is feasible with realistic noise levels and little envelope information is required if a shrink‐wrap algorithm is also incorporated. Some practical aspects of the proposed experiments are explored.
Methods for reconstructing electron densities from diffraction amplitudes alone, measured from single 1D crystals, are described and illustrated by simulation. Ab initio phasing is demonstrated using an iterative projection algorithm.
Multiple studies have shown how dendrites enable some neurons to perform linearly non-separable computations. These works focus on cells with an extended dendritic arbor where voltage can vary ...independently, turning dendritic branches into local non-linear subunits. However, these studies leave a large fraction of the nervous system unexplored. Many neurons, e.g. granule cells, have modest dendritic trees and are electrically compact. It is impossible to decompose them into multiple independent subunits. Here, we upgraded the integrate and fire neuron to account for saturating dendrites. This artificial neuron has a unique membrane voltage and can be seen as a single layer. We present a class of linearly non-separable computations and how our neuron can perform them. We thus demonstrate that even a single layer neuron with dendrites has more computational capacity than without. Because any neuron has one or more layer, and all dendrites do saturate, we show that any dendrited neuron can implement linearly non-separable computations.
In theory, neurons modelled as single layer perceptrons can implement all linearly separable computations. In practice, however, these computations may require arbitrarily precise synaptic weights. ...This is a strong constraint since both biological neurons and their artificial counterparts have to cope with limited precision. Here, we explore how non-linear processing in dendrites helps overcome this constraint. We start by finding a class of computations which requires increasing precision with the number of inputs in a perceptron and show that it can be implemented without this constraint in a neuron with sub-linear dendritic subunits. Then, we complement this analytical study by a simulation of a biophysical neuron model with two passive dendrites and a soma, and show that it can implement this computation. This work demonstrates a new role of dendrites in neural computation: by distributing the computation across independent subunits, the same computation can be performed more efficiently with less precise tuning of the synaptic weights. This work not only offers new insight into the importance of dendrites for biological neurons, but also paves the way for new, more efficient architectures of artificial neuromorphic chips.
The main identified function of BCL2 protein is to prevent cell death by apoptosis. Mouse knock-out for Bcl2 demonstrates growth retardation, severe polycystic kidney disease (PKD), grey hair and ...lymphopenia, and die prematurely after birth. Here, we report a 40-year-old male referred to for abdominal and thoracic aortic dissection with associated aortic root aneurysm, PKD, lymphocytopenia with a history of T cell lymphoblastic lymphoma, white hair since the age of 20, and learning difficulties. PKD, which was also detected in the father and sister, was related to an inherited PKD1 mutation. The combination of PKD with grey hair and lymphocytopenia was also reminiscent of Bcl2-/- mouse phenotype. BCL2 gene transcript and protein level were observed to be dramatically decreased in patient peripheral blood T-cells and in his aorta vascular wall cells, which was not detected in parents and sister T-cells, suggesting an autosomal recessive inheritance. Accordingly, spontaneous apoptosis of patient T-cells was increased and could be rescued through stimulation with an anti-CD3 antibody. Direct sequencing of BCL2 gene exons, promoter and 3'UTR region as well as BCL2 mRNA sequencing failed in identifying any pathogenic variant. Array-CGH was also normal and whole exome sequencing of the patient, parents and sister DNA did not detect any significant variant in genes encoding BCL2-interacting proteins. miRNA array identified an up-regulation of miR-181a, which is a known regulator of BCL2 expression. Altogether, miR-181a-mediated decrease in BCL2 gene expression could be a modifying factor that aggravates the phenotype of a PKD1 constitutive variant.
In theory, neurons modelled as single layer perceptrons can implement all linearly separable computations. In practice, however, these computations may require arbitrarily precise synaptic weights. ...This is a strong constraint since both biological neurons and their artificial counterparts have to cope with limited precision. Here, we explore how non-linear processing in dendrites helps overcome this constraint. We start by finding a class of computations which requires increasing precision with the number of inputs in a Perceptron and show that it can be implemented without this constraint in a neuron with sub-linear dendritic subunits. Then, we complement this analytical study by a simulation of a biophysical neuron model with two passive dendrites and a soma, and show that it can implement this computation. This work demonstrates a new role of dendrites in neural computation: by distributing the computation across independent subunits, the same computation can be performed more efficiently with less precise tuning of the synaptic weights. This work not only offers new insight into the importance of dendrites for biological neurons, but also paves the way for new, more efficient architectures of artificial neuromorphic chips.
A phasing algorithm for macromolecular crystallography is proposed that utilizes diffraction data from multiple crystal forms – crystals of the same molecule with different unit‐cell packings ...(different unit‐cell parameters or space‐group symmetries). The approach is based on the method of iterated projections, starting with no initial phase information. The practicality of the method is demonstrated by simulation using known structures that exist in multiple crystal forms, assuming some information on the molecular envelope and positional relationships between the molecules in the different unit cells. With incorporation of new or existing methods for determination of these parameters, the approach has potential as a method for ab initio phasing.
A phasing algorithm for protein crystallography using diffraction data from multiple crystal forms is proposed. The algorithm is evaluated by simulation, and practical aspects and potential for ab initio phasing are discussed.