Retrospective model-based inference guides model-free credit assignment

An extensive reinforcement learning literature shows that organisms assign credit efficiently, even under conditions of state uncertainty. However, little is known about credit-assignment when state uncertainty is subsequently resolved. Here, we address this problem within the framework of an interaction between model-free (MF) and model-based (MB) control systems. We present and support experimentally a theory of MB retrospective-inference. Within this framework, a MB system resolves uncertainty that prevailed when actions were taken thus guiding an MF credit-assignment. Using a task in which there was initial uncertainty about the lotteries that were chosen, we found that when participants’ momentary uncertainty about which lottery had generated an outcome was resolved by provision of subsequent information, participants preferentially assigned credit within a MF system to the lottery they retrospectively inferred was responsible for this outcome. These findings extend our knowledge about the range of MB functions and the scope of system interactions

Guanylyl cyclase activity associated with putative bifunctional integral membrane proteins in Plasmodium falciparum.

We report here that guanylyl cyclase activity is associated with two large integral membrane proteins (PfGCalpha and PfGCbeta) in the human malaria parasite Plasmodium falciparum. Unusually, the proteins appear to be bifunctional; their amino-terminal regions have strong similarity with P-type ATPases, and the sequence and structure of the carboxyl-terminal regions conform to that of G protein-dependent adenylyl cyclases, with two sets of six transmembrane sequences, each followed by a catalytic domain (C1 and C2). However, amino acids that are enzymatically important and present in the C2 domain of mammalian adenylyl cyclases are located in the C1 domain of the P. falciparum proteins and vice versa. In addition, certain key residues in these domains are more characteristic of guanylyl cyclases. Consistent with this, guanylyl cyclase activity was obtained following expression of the catalytic domains of PfGCbeta in Escherichia coli. In P. falciparum, expression of both genes was detectable in the sexual but not the asexual blood stages of the life cycle, and PfGCalpha was localized to the parasite/parasitophorous vacuole membrane region of gametocytes. The profound structural differences identified between mammalian and parasite guanylyl cyclases suggest that aspects of this signaling pathway may be mechanistically distinct

Role of the mesoamygdaloid dopamine projection in emotional learning

Amygdala dopamine is crucially involved in the acquisition of Pavlovian associations, as measured via conditioned approach to the location of the unconditioned stimulus (US). However, learning begins before skeletomotor output, so this study assessed whether amygdala dopamine is also involved in earlier 'emotional' learning. A variant of the conditioned reinforcement (CR) procedure was validated where training was restricted to curtail the development of selective conditioned approach to the US location, and effects of amygdala dopamine manipulations before training or later CR testing assessed. Experiment 1a presented a light paired (CS+ group) or unpaired (CS- group) with a US. There were 1, 2 or 10 sessions, 4 trials per session. Then, the US was removed, and two novel levers presented. One lever (CR+) presented the light, and lever pressing was recorded. Experiment 1b also included a tone stimulus. Experiment 2 applied intra-amygdala R(+) 7-OH-DPAT (10 nmol/1.0 A mu l/side) before two training sessions (Experiment 2a) or a CR session (Experiment 2b). For Experiments 1a and 1b, the CS+ group preferred the CR+ lever across all sessions. Conditioned alcove approach during 1 or 2 training sessions or associated CR tests was low and nonspecific. In Experiment 2a, R(+) 7-OH-DPAT before training greatly diminished lever pressing during a subsequent CR test, preferentially on the CR+ lever. For Experiment 2b, R(+) 7-OH-DPAT infusions before the CR test also reduced lever pressing. Manipulations of amygdala dopamine impact the earliest stage of learning in which emotional reactions may be most prevalent

Genetic inhibition of neurotransmission reveals role of glutamatergic input to dopamine neurons in high-effort behavior

Midbrain dopamine neurons are crucial for many behavioral and cognitive functions. As the major excitatory input, glutamatergic afferents are important for control of the activity and plasticity of dopamine neurons. However, the role of glutamatergic input as a whole onto dopamine neurons remains unclear. Here we developed a mouse line in which glutamatergic inputs onto dopamine neurons are specifically impaired, and utilized this genetic model to directly test the role of glutamatergic inputs in dopamine-related functions. We found that while motor coordination and reward learning were largely unchanged, these animals showed prominent deficits in effort-related behavioral tasks. These results provide genetic evidence that glutamatergic transmission onto dopaminergic neurons underlies incentive motivation, a willingness to exert high levels of effort to obtain reinforcers, and have important implications for understanding the normal function of the midbrain dopamine system.Fil: Hutchison, M. A.. National Institutes of Health; Estados UnidosFil: Gu, X.. National Institutes of Health; Estados UnidosFil: Adrover, Martín Federico. National Institutes of Health; Estados Unidos. Consejo Nacional de Investigaciones Científicas y Técnicas. Instituto de Investigaciones en Ingeniería Genética y Biología Molecular "Dr. Héctor N. Torres"; ArgentinaFil: Lee, M. R.. National Institutes of Health; Estados UnidosFil: Hnasko, T. S.. University of California at San Diego; Estados UnidosFil: Alvarez, V. A.. National Institutes of Health; Estados UnidosFil: Lu, W.. National Institutes of Health; Estados Unido

Beyond handover: supporting awareness for continuous coverage

Abstract Hospitals are required to operate as a continuous system because patient care cannot be temporarily suspended and handover is seen as a key method for enabling this. This paper reports a study of handover in a medical admissions unit. We draw on the notion of awareness as conceptualised within the Computer Supported Cooperative Work literature to explore the role played by a variety of cognitive artifacts in supporting continuous coverage. While such awareness is typically characterised as being ‘effortless’, our study reveals that maintaining awareness in a context such as the medical admissions unit is effortful due to invisible work. We suggest that the notion of awareness is beneficial for exploring the practices of continuous coverage because it moves attention away from the moment of handover, instead encouraging consideration of the variety of practices through which clinicians display their work to, and monitor the work of, colleagues on different shifts. We argue that efforts to support continuous coverage should focus on improving awareness by increasing the visibility of information

Design of dynamic experiments for black-box model discrimination

Diverse domains of science and engineering require and use mechanistic mathematical models, e.g. systems of differential algebraic equations. Such models often contain uncertain parameters to be estimated from data. Consider a dynamic model discrimination setting where we wish to chose: (i) what is the best mechanistic, time-varying model and (ii) what are the best model parameter estimates. These tasks are often termed model discrimination/selection/validation/verification. Typically, several rival mechanistic models can explain data, so we incorporate available data and also run new experiments to gather more data. Design of dynamic experiments for model discrimination helps optimally collect data. For rival mechanistic models where we have access to gradient information, we extend existing methods to incorporate a wider range of problem uncertainty and show that our proposed approach is equivalent to historical approaches when limiting the types of considered uncertainty. We also consider rival mechanistic models as dynamic black boxes that we can evaluate, e.g. by running legacy code, but where gradient or other advanced information is unavailable. We replace these black-box models with Gaussian process surrogate models and thereby extend the model discrimination setting to additionally incorporate rival black-box model. We also explore the consequences of using Gaussian process surrogates to approximate gradient-based methods

Multiple ITS Copies Reveal Extensive Hybridization within Rheum (Polygonaceae), a Genus That Has Undergone Rapid Radiation

During adaptive radiation events, characters can arise multiple times due to parallel evolution, but transfer of traits through hybridization provides an alternative explanation for the same character appearing in apparently non-sister lineages. The signature of hybridization can be detected in incongruence between phylogenies derived from different markers, or from the presence of two divergent versions of a nuclear marker such as ITS within one individual.In this study, we cloned and sequenced ITS regions for 30 species of the genus Rheum, and compared them with a cpDNA phylogeny. Seven species contained two divergent copies of ITS that resolved in different clades from one another in each case, indicating hybridization events too recent for concerted evolution to have homogenised the ITS sequences. Hybridization was also indicated in at least two further species via incongruence in their position between ITS and cpDNA phylogenies. None of the ITS sequences present in these nine species matched those detected in any other species, which provides tentative evidence against recent introgression as an explanation. Rheum globulosum, previously indicated by cpDNA to represent an independent origin of decumbent habit, is indicated by ITS to be part of clade of decumbent species, which acquired cpDNA of another clade via hybridization. However decumbent and glasshouse morphology are confirmed to have arisen three and two times, respectively.These findings suggested that hybridization among QTP species of Rheum has been extensive, and that a role of hybridization in diversification of Rheum requires investigation

Observation of associated near-side and away-side long-range correlations in √sNN=5.02 TeV proton-lead collisions with the ATLAS detector

Two-particle correlations in relative azimuthal angle (Δϕ) and pseudorapidity (Δη) are measured in √sNN=5.02  TeV p+Pb collisions using the ATLAS detector at the LHC. The measurements are performed using approximately 1  μb-1 of data as a function of transverse momentum (pT) and the transverse energy (ΣETPb) summed over 3.1<η<4.9 in the direction of the Pb beam. The correlation function, constructed from charged particles, exhibits a long-range (2<|Δη|<5) “near-side” (Δϕ∼0) correlation that grows rapidly with increasing ΣETPb. A long-range “away-side” (Δϕ∼π) correlation, obtained by subtracting the expected contributions from recoiling dijets and other sources estimated using events with small ΣETPb, is found to match the near-side correlation in magnitude, shape (in Δη and Δϕ) and ΣETPb dependence. The resultant Δϕ correlation is approximately symmetric about π/2, and is consistent with a dominant cos⁡2Δϕ modulation for all ΣETPb ranges and particle pT

Search for direct pair production of the top squark in all-hadronic final states in proton-proton collisions at s√=8 TeV with the ATLAS detector

The results of a search for direct pair production of the scalar partner to the top quark using an integrated luminosity of 20.1fb−1 of proton–proton collision data at √s = 8 TeV recorded with the ATLAS detector at the LHC are reported. The top squark is assumed to decay via t˜→tχ˜01 or t˜→ bχ˜±1 →bW(∗)χ˜01 , where χ˜01 (χ˜±1 ) denotes the lightest neutralino (chargino) in supersymmetric models. The search targets a fully-hadronic final state in events with four or more jets and large missing transverse momentum. No significant excess over the Standard Model background prediction is observed, and exclusion limits are reported in terms of the top squark and neutralino masses and as a function of the branching fraction of t˜ → tχ˜01 . For a branching fraction of 100%, top squark masses in the range 270–645 GeV are excluded for χ˜01 masses below 30 GeV. For a branching fraction of 50% to either t˜ → tχ˜01 or t˜ → bχ˜±1 , and assuming the χ˜±1 mass to be twice the χ˜01 mass, top squark masses in the range 250–550 GeV are excluded for χ˜01 masses below 60 GeV

Search for new phenomena in final states with an energetic jet and large missing transverse momentum in pp collisions at √ s = 8 TeV with the ATLAS detector

Results of a search for new phenomena in final states with an energetic jet and large missing transverse momentum are reported. The search uses 20.3 fb−1 of √ s = 8 TeV data collected in 2012 with the ATLAS detector at the LHC. Events are required to have at least one jet with pT > 120 GeV and no leptons. Nine signal regions are considered with increasing missing transverse momentum requirements between Emiss T > 150 GeV and Emiss T > 700 GeV. Good agreement is observed between the number of events in data and Standard Model expectations. The results are translated into exclusion limits on models with either large extra spatial dimensions, pair production of weakly interacting dark matter candidates, or production of very light gravitinos in a gauge-mediated supersymmetric model. In addition, limits on the production of an invisibly decaying Higgs-like boson leading to similar topologies in the final state are presente