Reliance on habits at the expense of goal-directed control following dopamine precursor depletion

Rationale Dopamine is well known to play an important role in learning and motivation. Recent animal studies have implicated dopamine in the reinforcement of stimulus-response habits, as well as in flexible, goal-directed action. However, the role of dopamine in human action control is still not well understood. Objectives We present the first investigation of the effect of reducing dopamine function in healthy volunteers on the balance between habitual and goal-directed action control. Methods The dietary intervention of acute dietary phenylalanine and tyrosine depletion (APTD) was adopted to study the effects of reduced global dopamine function on action control. Participants were randomly assigned to either the APTD or placebo group (ns = 14) to allow for a between-subjects comparison of performance on a novel three-stage experimental paradigm. In the initial learning phase, participants learned to respond to different stimuli in order to gain rewarding outcomes. Subsequently, an outcome-devaluation test and a slips-of-action test were conducted to assess whether participants were able to flexibly adjust their behaviour to changes in the desirability of the outcomes. Results APTD did not prevent stimulus-response learning, nor did we find evidence for impaired response-outcome learning in the subsequent outcome-devaluation test. However, when goal-directed and habitual systems competed for control in the slips-of-action test, APTD tipped the balance towards habitual control. These findings were restricted to female volunteers. Conclusions We provide direct evidence that the balance between goal-directed and habitual control in humans is dopamine dependent. The results are discussed in light of gender differences in dopamine function and psychopathologies

Safety out of control: dopamine and defence

We enjoy a sophisticated understanding of how animals learn to predict appetitive outcomes and direct their behaviour accordingly. This encompasses well-defined learning algorithms and details of how these might be implemented in the brain. Dopamine has played an important part in this unfolding story, appearing to embody a learning signal for predicting rewards and stamping in useful actions, while also being a modulator of behavioural vigour. By contrast, although choosing correct actions and executing them vigorously in the face of adversity is at least as important, our understanding of learning and behaviour in aversive settings is less well developed. We examine aversive processing through the medium of the role of dopamine and targets such as D2 receptors in the striatum. We consider critical factors such as the degree of control that an animal believes it exerts over key aspects of its environment, the distinction between 'better' and 'good' actual or predicted future states, and the potential requirement for a particular form of opponent to dopamine to ensure proper calibration of state values