A new framework for cortico-striatal plasticity: behavioural theory meets In vitro data at the reinforcement-action interface

Operant learning requires that reinforcement signals interact with action representations at a suitable neural interface. Much evidence suggests that this occurs when phasic dopamine, acting as a reinforcement prediction error, gates plasticity at cortico-striatal synapses, and thereby changes the future likelihood of selecting the action(s) coded by striatal neurons. But this hypothesis faces serious challenges. First, cortico-striatal plasticity is inexplicably complex, depending on spike timing, dopamine level, and dopamine receptor type. Second, there is a credit assignment problem—action selection signals occur long before the consequent dopamine reinforcement signal. Third, the two types of striatal output neuron have apparently opposite effects on action selection. Whether these factors rule out the interface hypothesis and how they interact to produce reinforcement learning is unknown. We present a computational framework that addresses these challenges. We first predict the expected activity changes over an operant task for both types of action-coding striatal neuron, and show they co-operate to promote action selection in learning and compete to promote action suppression in extinction. Separately, we derive a complete model of dopamine and spike-timing dependent cortico-striatal plasticity from in vitro data. We then show this model produces the predicted activity changes necessary for learning and extinction in an operant task, a remarkable convergence of a bottom-up data-driven plasticity model with the top-down behavioural requirements of learning theory. Moreover, we show the complex dependencies of cortico-striatal plasticity are not only sufficient but necessary for learning and extinction. Validating the model, we show it can account for behavioural data describing extinction, renewal, and reacquisition, and replicate in vitro experimental data on cortico-striatal plasticity. By bridging the levels between the single synapse and behaviour, our model shows how striatum acts as the action-reinforcement interface

Genetic dissection of an amygdala microcircuit that gates conditioned fear

The role of different amygdala nuclei (neuroanatomical subdivisions) in processing Pavlovian conditioned fear has been studied extensively, but the function of the heterogeneous neuronal subtypes within these nuclei remains poorly understood. Here we use molecular genetic approaches to map the functional connectivity of a subpopulation of GABA-containing neurons, located in the lateral subdivision of the central amygdala (CEl), which express protein kinase C-δ (PKC-δ). Channelrhodopsin-2-assisted circuit mapping in amygdala slices and cell-specific viral tracing indicate that PKC-δ^+ neurons inhibit output neurons in the medial central amygdala (CEm), and also make reciprocal inhibitory synapses with PKC-δ^− neurons in CEl. Electrical silencing of PKC-δ^+ neurons in vivo suggests that they correspond to physiologically identified units that are inhibited by the conditioned stimulus, called Cel_(off) units. This correspondence, together with behavioural data, defines an inhibitory microcircuit in CEl that gates CEm output to control the level of conditioned freezing

Activation of D2 dopamine receptor-expressing neurons in the nucleus accumbens increases motivation.

Striatal dopamine receptor D1-expressing neurons have been classically associated with positive reinforcement and reward, whereas D2 neurons are associated with negative reinforcement and aversion. Here we demonstrate that the pattern of activation of D1 and D2 neurons in the nucleus accumbens (NAc) predicts motivational drive, and that optogenetic activation of either neuronal population enhances motivation in mice. Using a different approach in rats, we further show that activating NAc D2 neurons increases cue-induced motivational drive in control animals and in a model that presents anhedonia and motivational deficits; conversely, optogenetic inhibition of D2 neurons decreases motivation. Our results suggest that the classic view of D1-D2 functional antagonism does not hold true for all dimensions of reward-related behaviours, and that D2 neurons may play a more prominent pro-motivation role than originally anticipated.A special acknowledgement to Karl Deisseroth from Stanford University, for providing viral constructs and for comments on the manuscript, and to Alan Dorval from the University of Utah, for providing mouse strains. Thanks to Luis Jacinto, Joao Oliveira and Joana Silva that helped in some technical aspects of the experiments. C.S.-C., B.C., A.D.-P. and S.B. are recipients of Fundacao para a Ciencia e Tecnologia (FCT) fellowships (SFRH/BD/51992/2012; SFRH/BD/98675/2013; SFRH/BD/90374/2012; SFRH/BD/89936/2012). A.J.R. is a FCT Investigator (IF/00883/2013). This work was co-financed by the Portuguese North Regional Operational Program (ON.2 - O Novo Norte) under the National Strategic Reference Framework (QREN), through the European Regional Development Fund (FEDER). Part of the work was supported by the Janssen Neuroscience Prize (1st edition).info:eu-repo/semantics/publishedVersio

Dopamine, affordance and active inference.

The role of dopamine in behaviour and decision-making is often cast in terms of reinforcement learning and optimal decision theory. Here, we present an alternative view that frames the physiology of dopamine in terms of Bayes-optimal behaviour. In this account, dopamine controls the precision or salience of (external or internal) cues that engender action. In other words, dopamine balances bottom-up sensory information and top-down prior beliefs when making hierarchical inferences (predictions) about cues that have affordance. In this paper, we focus on the consequences of changing tonic levels of dopamine firing using simulations of cued sequential movements. Crucially, the predictions driving movements are based upon a hierarchical generative model that infers the context in which movements are made. This means that we can confuse agents by changing the context (order) in which cues are presented. These simulations provide a (Bayes-optimal) model of contextual uncertainty and set switching that can be quantified in terms of behavioural and electrophysiological responses. Furthermore, one can simulate dopaminergic lesions (by changing the precision of prediction errors) to produce pathological behaviours that are reminiscent of those seen in neurological disorders such as Parkinson's disease. We use these simulations to demonstrate how a single functional role for dopamine at the synaptic level can manifest in different ways at the behavioural level

The protocadherin 17 gene affects cognition, personality, amygdala structure and function, synapse development and risk of major mood disorders

Major mood disorders, which primarily include bipolar disorder and major depressive disorder, are the leading cause of disability worldwide and pose a major challenge in identifying robust risk genes. Here, we present data from independent large-scale clinical data sets (including 29 557 cases and 32 056 controls) revealing brain expressed protocadherin 17 (PCDH17) as a susceptibility gene for major mood disorders. Single-nucleotide polymorphisms (SNPs) spanning the PCDH17 region are significantly associated with major mood disorders; subjects carrying the risk allele showed impaired cognitive abilities, increased vulnerable personality features, decreased amygdala volume and altered amygdala function as compared with non-carriers. The risk allele predicted higher transcriptional levels of PCDH17 mRNA in postmortem brain samples, which is consistent with increased gene expression in patients with bipolar disorder compared with healthy subjects. Further, overexpression of PCDH17 in primary cortical neurons revealed significantly decreased spine density and abnormal dendritic morphology compared with control groups, which again is consistent with the clinical observations of reduced numbers of dendritic spines in the brains of patients with major mood disorders. Given that synaptic spines are dynamic structures which regulate neuronal plasticity and have crucial roles in myriad brain functions, this study reveals a potential underlying biological mechanism of a novel risk gene for major mood disorders involved in synaptic function and related intermediate phenotypes

Misconceptions about Aerobic and Anaerobic Energy Expenditure

The measurement of gas exchange has played an invaluable role in metabolic interpretation. The uptake of 1 liter of oxygen is often converted into an energy expenditure estimate of 21.1 kilojoules (e.g., 1 L O2 = 21.1 kJ or ~5 kcal). This article demonstrates both the importance of such a conversion and the potential for misinterpretation. Oxygen uptake during heavy and severe exercise will also be discussed

Why do patients want to have their blood tested? A qualitative study of patient expectations in general practice

BACKGROUND: General practitioners often take their impression of patients' expectations into account in their decision to have blood tests done. It is commonly recommended to involve patients in decision-making during consultations. The study aimed to obtain detailed information on patients' expectations about blood tests. METHODS: Qualitative study among patients in waiting rooms of general practices. Each patient was presented with a short questionnaire about their preferences in terms of diagnostics. Patients who would like blood tests to be done were interviewed. RESULTS: Fifty-seven (26%) of the 224 respondents wanted blood tests. Twenty-two were interviewed. Patients overestimated the qualities of blood tests. Favourable test results were regarded as proof of good health. Patients regarded blood tests as a useful instrument to screen for serious disorders, and were confirmed in this belief by people in their social environment and by the media. Many patients expected their GP to take an active test ordering approach, though some indicated that they might be convinced if their GP proposed a wait-and-see policy. CONCLUSIONS: GPs' perceptions about patient expectations seem justified: patients appear to have high hopes for testing as a diagnostic tool. They expect diagnostic certainty without mistakes and a proof of good health. The question is whether it would be desirable to remove patients' misconceptions, allowing them to participate in policy decisions on the basis of sound information, or whether it would be better to leave the misconceptions uncontested, in order to retain the 'magic' of additional tests and reassure patients. We expect that clarifying the precise nature of patients' expectations by the GP may be helpful in creating a diagnostic strategy that satisfies both patients and GPs. GPs will have to balance the benefits of reassuring their patients by means of blood tests which may be unnecessary against the benefits of avoiding unnecessary tests. Further research is needed into the effects of different types of patient information and the effects of testing on satisfaction and anxiety

Dealing with heterogeneity of treatment effects: is the literature up to the challenge?

<p>Abstract</p> <p>Background</p> <p>Some patients will experience more or less benefit from treatment than the averages reported from clinical trials; such variation in therapeutic outcome is termed heterogeneity of treatment effects (HTE). Identifying HTE is necessary to individualize treatment. The degree to which heterogeneity is sought and analyzed correctly in the general medical literature is unknown. We undertook this literature sample to track the use of HTE analyses over time, examine the appropriateness of the statistical methods used, and explore the predictors of such analyses.</p> <p>Methods</p> <p>Articles were selected through a probability sample of randomized controlled trials (RCTs) published in <it>Annals of Internal Medicine</it>, <it>BMJ</it>, <it>JAMA</it>, <it>The Lancet</it>, and <it>NEJM </it>during odd numbered months of 1994, 1999, and 2004. RCTs were independently reviewed and coded by two abstractors, with adjudication by a third. Studies were classified as reporting: (1) HTE analysis, utilizing a formal test for heterogeneity or treatment-by-covariate interaction, (2) subgroup analysis only, involving no formal test for heterogeneity or interaction; or (3) neither. Chi-square tests and multiple logistic regression were used to identify variables associated with HTE reporting.</p> <p>Results</p> <p>319 studies were included. Ninety-two (29%) reported HTE analysis; another 88 (28%) reported subgroup analysis only, without examining HTE formally. Major covariates examined included individual risk factors associated with prognosis, responsiveness to treatment, or vulnerability to adverse effects of treatment (56%); gender (30%); age (29%); study site or center (29%); and race/ethnicity (7%). Journal of publication and sample size were significant independent predictors of HTE analysis (p < 0.05 and p < 0.001, respectively).</p> <p>Conclusion</p> <p>HTE is frequently ignored or incorrectly analyzed. An iterative process of exploratory analysis followed by confirmatory HTE analysis will generate the data needed to facilitate an individualized approach to evidence-based medicine.</p

Acute Effects of Nicotine Amplify Accumbal Neural Responses during Nicotine-Taking Behavior and Nicotine-Paired Environmental Cues

Nicotine self-administration (SA) is maintained by several variables, including the reinforcing properties of nicotine-paired cues and the nicotine-induced amplification of those cue properties. The nucleus accumbens (NAc) is implicated in mediating the influence of these variables, though the underlying neurophysiological mechanisms are not yet understood. In the present study, Long-Evans rats were trained to self-administer nicotine. During SA sessions each press of a lever was followed by an intravenous infusion of nicotine (30 µg/kg) paired with a combined light-tone cue. Extracellular recordings of single-neuron activity showed that 20% of neurons exhibited a phasic change in firing during the nicotine-directed operant, the light-tone cue, or both. The phasic change in firing for 98% of neurons was an increase. Sixty-two percent of NAc neurons additionally or alternatively showed a sustained decrease in average firing during the SA session relative to a presession baseline period. These session decreases in firing were significantly less prevalent in a group of neurons that were activated during either the operant or the cue than in a group of neurons that were nonresponsive during those events (referred to as task-activated and task-nonactivated neurons, respectively). Moreover, the session decrease in firing was dose-dependent for only the task-nonactivated neurons. The data of the present investigation provide supportive correlational evidence for two hypotheses: (1) excitatory neurophysiological mechanisms mediate the NAc role in cue-maintenance of nicotine SA, and (2) a differential nicotine-induced inhibition of task-activated and task-nonactivated neurons mediates the NAc role in nicotine-induced amplification of cue effects on nicotine SA

The Effect of Sensory Uncertainty Due to Amblyopia (Lazy Eye) on the Planning and Execution of Visually-Guided 3D Reaching Movements

Background: Impairment of spatiotemporal visual processing in amblyopia has been studied extensively, but its effects on visuomotor tasks have rarely been examined. Here, we investigate how visual deficits in amblyopia affect motor planning and online control of visually-guided, unconstrained reaching movements. Methods: Thirteen patients with mild amblyopia, 13 with severe amblyopia and 13 visually-normal participants were recruited. Participants reached and touched a visual target during binocular and monocular viewing. Motor planning was assessed by examining spatial variability of the trajectory at 50–100 ms after movement onset. Online control was assessed by examining the endpoint variability and by calculating the coefficient of determination (R 2) which correlates the spatial position of the limb during the movement to endpoint position. Results: Patients with amblyopia had reduced precision of the motor plan in all viewing conditions as evidenced by increased variability of the reach early in the trajectory. Endpoint precision was comparable between patients with mild amblyopia and control participants. Patients with severe amblyopia had reduced endpoint precision along azimuth and elevation during amblyopic eye viewing only, and along the depth axis in all viewing conditions. In addition, they had significantly higher R 2 values at 70 % of movement time along the elevation and depth axes during amblyopic eye viewing. Conclusion: Sensory uncertainty due to amblyopia leads to reduced precision of the motor plan. The ability to implemen