Neural Signatures of Value Comparison in Human Cingulate Cortex during Decisions Requiring an Effort-Reward Trade-off

UNLABELLED: Integrating costs and benefits is crucial for optimal decision-making. Although much is known about decisions that involve outcome-related costs (e.g., delay, risk), many of our choices are attached to actions and require an evaluation of the associated motor costs. Yet how the brain incorporates motor costs into choices remains largely unclear. We used human fMRI during choices involving monetary reward and physical effort to identify brain regions that serve as a choice comparator for effort-reward trade-offs. By independently varying both options' effort and reward levels, we were able to identify the neural signature of a comparator mechanism. A network involving supplementary motor area and the caudal portion of dorsal anterior cingulate cortex encoded the difference in reward (positively) and effort levels (negatively) between chosen and unchosen choice options. We next modeled effort-discounted subjective values using a novel behavioral model. This revealed that the same network of regions involving dorsal anterior cingulate cortex and supplementary motor area encoded the difference between the chosen and unchosen options' subjective values, and that activity was best described using a concave model of effort-discounting. In addition, this signal reflected how precisely value determined participants' choices. By contrast, separate signals in supplementary motor area and ventromedial prefrontal cortex correlated with participants' tendency to avoid effort and seek reward, respectively. This suggests that the critical neural signature of decision-making for choices involving motor costs is found in human cingulate cortex and not ventromedial prefrontal cortex as typically reported for outcome-based choice. Furthermore, distinct frontal circuits seem to drive behavior toward reward maximization and effort minimization. SIGNIFICANCE STATEMENT: The neural processes that govern the trade-off between expected benefits and motor costs remain largely unknown. This is striking because energetic requirements play an integral role in our day-to-day choices and instrumental behavior, and a diminished willingness to exert effort is a characteristic feature of a range of neurological disorders. We use a new behavioral characterization of how humans trade off reward maximization with effort minimization to examine the neural signatures that underpin such choices, using BOLD MRI neuroimaging data. We find the critical neural signature of decision-making, a signal that reflects the comparison of value between choice options, in human cingulate cortex, whereas two distinct brain circuits drive behavior toward reward maximization or effort minimization

Investigation of the neurovascular coupling in positive and negative BOLD responses in human brain at 7T

Decreases in stimulus-dependent blood oxygenation level dependent (BOLD) signal and their underlying neurovascular origins have recently gained considerable interest. In this study a multi-echo, BOLD-corrected vascular space occupancy (VASO) functional magnetic resonance imaging (fMRI) technique was used to investigate neurovascular responses during stimuli that elicit positive and negative BOLD responses in human brain at 7 T. Stimulus-induced BOLD, cerebral blood volume (CBV), and cerebral blood flow (CBF) changes were measured and analyzed in ‘arterial’ and ‘venous’ blood compartments in macro- and microvasculature. We found that the overall interplay of mean CBV, CBF and BOLD responses is similar for tasks inducing positive and negative BOLD responses. Some aspects of the neurovascular coupling however, such as the temporal response, cortical depth dependence, and the weighting between ‘arterial’ and ‘venous’ contributions, are significantly different for the different task conditions. Namely, while for excitatory tasks the BOLD response peaks at the cortical surface, and the CBV change is similar in cortex and pial vasculature, inhibitory tasks are associated with a maximum negative BOLD response in deeper layers, with CBV showing strong constriction of surface arteries and a faster return to baseline. The different interplays of CBV, CBF and BOLD during excitatory and inhibitory responses suggests different underlying hemodynamic mechanisms

Neural Signatures of Value Comparison in Human Cingulate Cortex during Decisions Requiring an Effort-Reward Trade-off

UNLABELLED: Integrating costs and benefits is crucial for optimal decision-making. Although much is known about decisions that involve outcome-related costs (e.g., delay, risk), many of our choices are attached to actions and require an evaluation of the associated motor costs. Yet how the brain incorporates motor costs into choices remains largely unclear. We used human fMRI during choices involving monetary reward and physical effort to identify brain regions that serve as a choice comparator for effort-reward trade-offs. By independently varying both options' effort and reward levels, we were able to identify the neural signature of a comparator mechanism. A network involving supplementary motor area and the caudal portion of dorsal anterior cingulate cortex encoded the difference in reward (positively) and effort levels (negatively) between chosen and unchosen choice options. We next modeled effort-discounted subjective values using a novel behavioral model. This revealed that the same network of regions involving dorsal anterior cingulate cortex and supplementary motor area encoded the difference between the chosen and unchosen options' subjective values, and that activity was best described using a concave model of effort-discounting. In addition, this signal reflected how precisely value determined participants' choices. By contrast, separate signals in supplementary motor area and ventromedial prefrontal cortex correlated with participants' tendency to avoid effort and seek reward, respectively. This suggests that the critical neural signature of decision-making for choices involving motor costs is found in human cingulate cortex and not ventromedial prefrontal cortex as typically reported for outcome-based choice. Furthermore, distinct frontal circuits seem to drive behavior toward reward maximization and effort minimization. SIGNIFICANCE STATEMENT: The neural processes that govern the trade-off between expected benefits and motor costs remain largely unknown. This is striking because energetic requirements play an integral role in our day-to-day choices and instrumental behavior, and a diminished willingness to exert effort is a characteristic feature of a range of neurological disorders. We use a new behavioral characterization of how humans trade off reward maximization with effort minimization to examine the neural signatures that underpin such choices, using BOLD MRI neuroimaging data. We find the critical neural signature of decision-making, a signal that reflects the comparison of value between choice options, in human cingulate cortex, whereas two distinct brain circuits drive behavior toward reward maximization or effort minimization

In the blink of an eye: Value and novelty drive saccades

Evidence accumulation is an essential component of value-based decisions. Recent human studies suggest that overt attention correlates with evidence accumulation necessary for optimal decisions. However, the influence of covert attention on decision-making remains relatively unexplored. To investigate this issue, two monkeys were trained to perform a decision-making task where they chose between two stimuli, which were either ‘Overtrained’ or learned that day (‘Novel’). Subjects could freely saccade during choice evaluation and indicated their decision by moving a joystick. Saccades were made within 170 ms of stimulus presentation and were strongly driven by both value and novelty, implying covert stimulus evaluation prior to saccade. This effect was strongest for ‘Overtrained’ choices, but rapidly emerged during learning of ‘Novel’ choices. Though novel stimuli attracted initial saccades, final decisions were guided only by value; implying attentional value comparison processes are at least partially dissociable from value comparison processes that govern final decisions. While subjects made highly optimal decisions, they frequently viewed only one stimulus; final choice was thus best explained by assuming covert evidence accumulation. Our results suggest that the primate brain contains multiple value comparison systems for guiding attention toward highly valuable or novel information while simultaneously optimizing final decision value

Capturing the temporal evolution of choice across prefrontal cortex

Activity in prefrontal cortex (PFC) has been richly described using economic models of choice. Yet such descriptions fail to capture the dynamics of decision formation. Describing dynamic neural processes has proven challenging due to the problem of indexing the internal state of PFC and its trial-by-trial variation. Using primate neurophysiology and human magnetoencephalography, we here recover a single-trial index of PFC internal states from multiple simultaneously recorded PFC subregions. This index can explain the origins of neural representations of economic variables in PFC. It describes the relationship between neural dynamics and behaviour in both human and monkey PFC, directly bridging between human neuroimaging data and underlying neuronal activity. Moreover, it reveals a functionally dissociable interaction between orbitofrontal cortex, anterior cingulate cortex and dorsolateral PFC in guiding cost-benefit decisions. We cast our observations in terms of a recurrent neural network model of choice, providing formal links to mechanistic dynamical accounts of decision-making

Abnormalities in whisking behaviour are associated with lesions in brain stem nuclei in a mouse model of amyotrophic lateral sclerosis

The transgenic SOD1G93A mouse is a model of human amyotrophic lateral sclerosis (ALS) and recapitulates many of the pathological hallmarks observed in humans, including motor neuron degeneration in the brain and the spinal cord. In mice, neurodegeneration particularly impacts on the facial nuclei in the brainstem. Motor neurons innervating the whisker pad muscles originate in the facial nucleus of the brain stem, with contractions of these muscles giving rise to “whisking” one of the fastest movements performed by mammals. A longitudinal study was conducted on SOD1G93A mice and wild-type litter mate controls, comparing: (i) whisker movements using high-speed video recordings and automated whisker tracking, and (ii) facial nucleus degeneration using MRI. Results indicate that while whisking still occurs in SOD1G93A mice and is relatively resistant to neurodegeneration, there are significant disruptions to certain whisking behaviours, which correlate with facial nuclei lesions, and may be as a result of specific facial muscle degeneration. We propose that measures of mouse whisker movement could potentially be used in tandem with measures of limb dysfunction as biomarkers of disease onset and progression in ALS mice and offers a novel method for testing the efficacy of novel therapeutic compounds

Comparison of stimulus-evoked cerebral hemodynamics in the awake mouse and under a novel anesthetic regime

Neural activity is closely followed by a localised change in cerebral blood flow, a process termed neurovascular coupling. These hemodynamic changes form the basis of contrast in functional magnetic resonance imaging (fMRI) and are used as a correlate for neural activity. Anesthesia is widely employed in animal fMRI and neurovascular studies, however anesthetics are known to profoundly affect neural and vascular physiology, particularly in mice. Therefore, we investigated the efficacy of a novel ‘modular’ anesthesia that combined injectable (fentanyl-fluanisone/midazolam) and volatile (isoflurane) anesthetics in mice. To characterize sensory-evoked cortical hemodynamic responses, we used optical imaging spectroscopy to produce functional maps of changes in tissue oxygenation and blood volume in response to mechanical whisker stimulation. Following fine-tuning of the anesthetic regime, stimulation elicited large and robust hemodynamic responses in the somatosensory cortex, characterized by fast arterial activation, increases in total and oxygenated hemoglobin, and decreases in deoxygenated hemoglobin. Overall, the magnitude and speed of evoked hemodynamic responses under anesthesia resembled those in the awake state, indicating that the novel anesthetic combination significantly minimizes the impact of anesthesia. Our findings have broad implications for both neurovascular research and longitudinal fMRI studies that increasingly require the use of genetically engineered mice

Neural computations underlying action-based decision making in the human brain

Action-based decision making involves choices between different physical actions to obtain rewards. To make such decisions the brain needs to assign a value to each action and then compare them to make a choice. Using fMRI in human subjects, we found evidence for action-value signals in supplementary motor cortex. Separate brain regions, most prominently ventromedial prefrontal cortex, were involved in encoding the expected value of the action that was ultimately taken. These findings differentiate two main forms of value signals in the human brain: those relating to the value of each available action, likely reflecting signals that are a precursor of choice, and those corresponding to the expected value of the action that is subsequently chosen, and therefore reflecting the consequence of the decision process. Furthermore, we also found signals in the dorsomedial frontal cortex that resemble the output of a decision comparator, which implicates this region in the computation of the decision itself

Contralateral dissociation between neural activity and cerebral blood volume during recurrent acute focal neocortical seizures

OBJECTIVE: Whether epileptic events disrupt normal neurovascular coupling mechanisms locally or remotely is unclear. We sought to investigate neurovascular coupling in an acute model of focal neocortical epilepsy, both within the seizure onset zone and in contralateral homotopic cortex. METHODS: Neurovascular coupling in both ipsilateral and contralateral vibrissal cortices of the urethane-anesthetized rat were examined during recurrent 4-aminopyridine (4-AP, 15 mm, 1 μl) induced focal seizures. Local field potential (LFP) and multiunit spiking activity (MUA) were recorded via two bilaterally implanted 16-channel microelectrodes. Concurrent two-dimensional optical imaging spectroscopy was used to produce spatiotemporal maps of cerebral blood volume (CBV). RESULTS: Recurrent acute seizures in right vibrissal cortex (RVC) produced robust ipsilateral increases in LFP and MUA activity, most prominently in layer 5, that were nonlinearly correlated to local increases in CBV. In contrast, contralateral left vibrissal cortex (LVC) exhibited relatively smaller nonlaminar specific increases in neural activity coupled with a decrease in CBV, suggestive of dissociation between neural and hemodynamic responses. SIGNIFICANCE: These findings provide insights into the impact of epileptic events on the neurovascular unit, and have important implications both for the interpretation of perfusion-based imaging signals in the disorder and understanding the widespread effects of epilepsy. A PowerPoint slide summarizing this article is available for download in the Supporting Information section here