A new framework for cortico-striatal plasticity: behavioural theory meets In vitro data at the reinforcement-action interface

Operant learning requires that reinforcement signals interact with action representations at a suitable neural interface. Much evidence suggests that this occurs when phasic dopamine, acting as a reinforcement prediction error, gates plasticity at cortico-striatal synapses, and thereby changes the future likelihood of selecting the action(s) coded by striatal neurons. But this hypothesis faces serious challenges. First, cortico-striatal plasticity is inexplicably complex, depending on spike timing, dopamine level, and dopamine receptor type. Second, there is a credit assignment problem—action selection signals occur long before the consequent dopamine reinforcement signal. Third, the two types of striatal output neuron have apparently opposite effects on action selection. Whether these factors rule out the interface hypothesis and how they interact to produce reinforcement learning is unknown. We present a computational framework that addresses these challenges. We first predict the expected activity changes over an operant task for both types of action-coding striatal neuron, and show they co-operate to promote action selection in learning and compete to promote action suppression in extinction. Separately, we derive a complete model of dopamine and spike-timing dependent cortico-striatal plasticity from in vitro data. We then show this model produces the predicted activity changes necessary for learning and extinction in an operant task, a remarkable convergence of a bottom-up data-driven plasticity model with the top-down behavioural requirements of learning theory. Moreover, we show the complex dependencies of cortico-striatal plasticity are not only sufficient but necessary for learning and extinction. Validating the model, we show it can account for behavioural data describing extinction, renewal, and reacquisition, and replicate in vitro experimental data on cortico-striatal plasticity. By bridging the levels between the single synapse and behaviour, our model shows how striatum acts as the action-reinforcement interface

Ethanol seeking triggered by environmental context is attenuated by blocking dopamine D1 receptors in the nucleus accumbens core and shell in rats

Conditioned behavioral responses to discrete drug-associated cues can be modulated by the environmental context in which those cues are experienced, a process that may facilitate relapse in humans. Rodent models of drug self-administration have been adapted to reveal the capacity of contexts to trigger drug seeking, thereby enabling neurobiological investigations of this effect. We tested the hypothesis that dopamine transmission in the nucleus accumbens, a neural structure that mediates reinforcement, is necessary for context-induced reinstatement of responding for ethanol-associated cues. Rats pressed one lever (active) for oral ethanol (0.1 ml; 10% v/v) in operant conditioning chambers distinguished by specific visual, olfactory, and tactile contextual stimuli. Ethanol delivery was paired with a discrete (4 s) light-noise stimulus. Responses on a second lever (inactive) were not reinforced. Behavior was then extinguished by withholding ethanol but not the discrete stimulus in a different context. Reinstatement, expressed as elevated responding for the discrete stimulus without ethanol delivery, was tested by placing rats into the prior self-administration context after administration of saline or the dopamine D1 receptor antagonist, SCH 23390 (0.006, 0.06, and 0.6 μg/side), into the nucleus accumbens core or shell. Compared with extinction responding, active lever pressing in saline-pretreated rats was enhanced by placement into the prior ethanol self-administration context. SCH 23390 dose-dependently reduced reinstatement after infusion into the core or shell. These findings suggest a critical role for dopamine acting via D1 receptors in the nucleus accumbens in the reinstatement of responding for ethanol cues triggered by placement into an ethanol-associated context

The impact of intolerance of uncertainty and cognitive behavioural instructions on safety learning

Background Difficulty updating threat associations to safe associations has been observed in individuals who score high in self-reported Intolerance of Uncertainty (IU). Here we sought to determine whether an instruction based on fundamental principles of Cognitive Behavioural Therapy could promote safety learning in individuals with higher levels of IU, whilst controlling for self-reported trait anxiety (STICSA). Methods We measured skin conductance response, pupil dilation and expectancy ratings during an associative threat learning task in which participants either received a cognitive behavioural instruction or no instruction prior to threat extinction (n = 92). Results Analyses revealed that both self-reported IU and STICSA similarly predicted differences in skin conductance response. Only individuals with lower IU/STICSA in the cognitive behavioural instruction condition displayed successful safety learning via skin conductance response. Conclusions These initial results provide some insight into how simple cognitive behavioural instructions combined with exposure are applied differently in individuals with varying levels of self-reported anxiety. The results further our understanding of the role of basic cognitive behavioural principles and self-reported anxiety in safety learning

Related to Anxiety: Arbitrarily Applicable Relational Responding and Experimental Psychopathology Research on Fear and Avoidance

Humans have an unparalleled ability to engage in arbitrarily applicable relational responding (AARR). One of the consequences of this ability to spontaneously combine and relate events from the past, present, and future may, in fact, be a propensity to suffer. For instance, maladaptive fear and avoidance of remote or derived threats may actually perpetuate anxiety. In this narrative review, we consider contemporary AARR research on fear and avoidance as it relates to anxiety. We first describe laboratory-based research on the emergent spread of fear- and avoidance-eliciting functions in humans. Next, we consider the validity of AARR research on fear and avoidance and address the therapeutic implications of the work. Finally, we outline challenges and opportunities for a greater synthesis between behavior analysis research on AARR and experimental psychopathology

Assessment of human–leopard conflict in Machiara National Park, Azad Jammu and Kashmir, Pakistan

Livestock depredation by leopards is one of the key conservation issues in landscapes with limited resources worldwide. Any attempts to mitigate human-leopard conflict and conserve the species in conflict should be based on an unequivocal understanding of the conflict patterns. A household survey was conducted with an intention to quantify livestock losses resulting from depredation by leopards in and around the Machiara National Park, Azad Jammu and Kashmir, Pakistan. A total of 301 livestock were killed between June 2007 and August 2008 by leopards. The extent of loss varied in different months, with maximum killing occurring in the month of May. Small-bodied livestock such as goats and sheep were more vulnerable than large-bodied cattle. Goats were killed in significantly higher numbers as compared to other livestock. Domestic animals were killed more frequently at night as compared to other times of the day. There was a significant effect of the nighttime protection measures on depredation. Most attacks happened in valleys and in areas far from the forests. Factors most closely associated with livestock depredation included decline of natural prey, herding practices, guarding especially during the nighttime, and repeated use of pastures where predators were known to be hunting actively. Attitudes of the local community towards leopards were largely negative, and further efforts should be made to improve support for carnivore conservation. We suggest widespread local community education and proactive human-leopard conflict management, particularly through adopting carnivore-friendly livestock protection measures.AJ&K wildlife & Fisheries departmen