Prioritized Sweeping Neural DynaQ with Multiple Predecessors, and Hippocampal Replays

During sleep and awake rest, the hippocampus replays sequences of place cells that have been activated during prior experiences. These have been interpreted as a memory consolidation process, but recent results suggest a possible interpretation in terms of reinforcement learning. The Dyna reinforcement learning algorithms use off-line replays to improve learning. Under limited replay budget, a prioritized sweeping approach, which requires a model of the transitions to the predecessors, can be used to improve performance. We investigate whether such algorithms can explain the experimentally observed replays. We propose a neural network version of prioritized sweeping Q-learning, for which we developed a growing multiple expert algorithm, able to cope with multiple predecessors. The resulting architecture is able to improve the learning of simulated agents confronted to a navigation task. We predict that, in animals, learning the world model should occur during rest periods, and that the corresponding replays should be shuffled.Comment: Living Machines 2018 (Paris, France

Why are Prices Sticky? Evidence from Business Survey Data

This paper offers new insights on the price setting behaviour of German retail firms using a novel dataset that consists of a large panel of monthly business surveys from 1991-2006. The firm-level data allows matching changes in firms' prices to several other firm-characteristics. Moreover, information on price expectations allow analyzing the determinants of price updating. Using univariate and bivariate ordered probit specifications, empirical menu cost models are estimated relating the probability of price adjustment and price updating, respectively, to both time- and state- dependent variables. First, results suggest an important role for state-dependence; changes in the macroeconomic and institutional environment as well as firm-specific factors are significantly related to the timing of price adjustment. These findings imply that price setting models should endogenize the timing of price adjustment in order to generate realistic predictions concerning the transmission of monetary policy. Second, an analysis of price expectations yields similar results providing evidence in favour of state-dependent sticky plan models. Third, intermediate input cost changes are among the most important determinants of price adjustment suggesting that pricing models should explicitly incorporate price setting at different production stages. However, the results show that adjustment to input cost changes takes time indicating "additional stickiness" at the last stage of processing

Evidence for the Rare Decay B -> K*ll and Measurement of the B -> Kll Branching Fraction

We present evidence for the flavor-changing neutral current decay $B\to K^*\ell^+\ell^-$ and a measurement of the branching fraction for the related process $B\to K\ell^+\ell^-$, where $\ell^+\ell^-$ is either an $e^+e^-$ or $\mu^+\mu^-$ pair. These decays are highly suppressed in the Standard Model, and they are sensitive to contributions from new particles in the intermediate state. The data sample comprises $123\times 10^6$ $\Upsilon(4S)\to B\bar{B}$ decays collected with the Babar detector at the PEP-II $e^+e^-$ storage ring. Averaging over $K^{(*)}$ isospin and lepton flavor, we obtain the branching fractions ${\mathcal B}(B\to K\ell^+\ell^-)=(0.65^{+0.14}_{-0.13}\pm 0.04)\times 10^{-6}$ and ${\mathcal B}(B\to K^*\ell^+\ell^-)=(0.88^{+0.33}_{-0.29}\pm 0.10)\times 10^{-6}$, where the uncertainties are statistical and systematic, respectively. The significance of the $B\to K\ell^+\ell^-$ signal is over $8\sigma$, while for $B\to K^*\ell^+\ell^-$ it is $3.3\sigma$.Comment: 7 pages, 2 postscript figues, submitted to Phys. Rev. Let

Frequency-specific hippocampal-prefrontal interactions during associative learning

Much of our knowledge of the world depends on learning associations (for example, face-name), for which the hippocampus (HPC) and prefrontal cortex (PFC) are critical. HPC-PFC interactions have rarely been studied in monkeys, whose cognitive and mnemonic abilities are akin to those of humans. We found functional differences and frequency-specific interactions between HPC and PFC of monkeys learning object pair associations, an animal model of human explicit memory. PFC spiking activity reflected learning in parallel with behavioral performance, whereas HPC neurons reflected feedback about whether trial-and-error guesses were correct or incorrect. Theta-band HPC-PFC synchrony was stronger after errors, was driven primarily by PFC to HPC directional influences and decreased with learning. In contrast, alpha/beta-band synchrony was stronger after correct trials, was driven more by HPC and increased with learning. Rapid object associative learning may occur in PFC, whereas HPC may guide neocortical plasticity by signaling success or failure via oscillatory synchrony in different frequency bands.National Institute of Mental Health (U.S.) (Conte Center Grant P50-MH094263-03)National Institute of Mental Health (U.S.) (Fellowship F32-MH081507)Picower Foundatio

Measurement of Branching Fraction and Dalitz Distribution for B0->D(*)+/- K0 pi-/+ Decays

We present measurements of the branching fractions for the three-body decays B0 -> D(*)-/+ K0 pi^+/-$and their resonant submodes$B0 -> D(*)-/+ K*+/- using a sample of approximately 88 million BBbar pairs collected by the BABAR detector at the PEP-II asymmetric energy storage ring. We measure: B(B0->D-/+ K0 pi+/-)=(4.9 +/- 0.7(stat) +/- 0.5 (syst)) 10^{-4} B(B0->D*-/+ K0 pi+/-)=(3.0 +/- 0.7(stat) +/- 0.3 (syst)) 10^{-4} B(B0->D-/+ K*+/-)=(4.6 +/- 0.6(stat) +/- 0.5 (syst)) 10^{-4} B(B0->D*-/+ K*+/-)=(3.2 +/- 0.6(stat) +/- 0.3 (syst)) 10^{-4} From these measurements we determine the fractions of resonant events to be : f(B0-> D-/+ K*+/-) = 0.63 +/- 0.08(stat) +/- 0.04(syst) f(B0-> D*-/+ K*+/-) = 0.72 +/- 0.14(stat) +/- 0.05(syst)Comment: 7 pages, 3 figures submitted to Phys. Rev. Let

Measurement of the quasi-elastic axial vector mass in neutrino-oxygen interactions

The weak nucleon axial-vector form factor for quasi-elastic interactions is determined using neutrino interaction data from the K2K Scintillating Fiber detector in the neutrino beam at KEK. More than 12,000 events are analyzed, of which half are charged-current quasi-elastic interactions nu-mu n to mu- p occurring primarily in oxygen nuclei. We use a relativistic Fermi gas model for oxygen and assume the form factor is approximately a dipole with one parameter, the axial vector mass M_A, and fit to the shape of the distribution of the square of the momentum transfer from the nucleon to the nucleus. Our best fit result for M_A = 1.20 \pm 0.12 GeV. Furthermore, this analysis includes updated vector form factors from recent electron scattering experiments and a discussion of the effects of the nucleon momentum on the shape of the fitted distributions.Comment: 14 pages, 10 figures, 6 table

Measurement of the Branching Fraction for B- --> D0 K*-

We present a measurement of the branching fraction for the decay B- --> D0 K*- using a sample of approximately 86 million BBbar pairs collected by the BaBar detector from e+e- collisions near the Y(4S) resonance. The D0 is detected through its decays to K- pi+, K- pi+ pi0 and K- pi+ pi- pi+, and the K*- through its decay to K0S pi-. We measure the branching fraction to be B.F.(B- --> D0 K*-)= (6.3 +/- 0.7(stat.) +/- 0.5(syst.)) x 10^{-4}.Comment: 7 pages, 1 postscript figure, submitted to Phys. Rev. D (Rapid Communications

Search for rare quark-annihilation decays, B --> Ds(*) Phi

We report on searches for B- --> Ds- Phi and B- --> Ds*- Phi. In the context of the Standard Model, these decays are expected to be highly suppressed since they proceed through annihilation of the b and u-bar quarks in the B- meson. Our results are based on 234 million Upsilon(4S) --> B Bbar decays collected with the BABAR detector at SLAC. We find no evidence for these decays, and we set Bayesian 90% confidence level upper limits on the branching fractions BF(B- --> Ds- Phi) Ds*- Phi)<1.2x10^(-5). These results are consistent with Standard Model expectations.Comment: 8 pages, 3 postscript figues, submitted to Phys. Rev. D (Rapid Communications

Measurement of the B+ --> p pbar K+ Branching Fraction and Study of the Decay Dynamics

With a sample of 232x10^6 Upsilon(4S) --> BBbar events collected with the BaBar detector, we study the decay B+ --> p pbar K+ excluding charmonium decays to ppbar. We measure a branching fraction Br(B+ --> p pbar K+)=(6.7+/-0.5+/-0.4)x10^{-6}. An enhancement at low ppbar mass is observed and the Dalitz plot asymmetry suggests dominance of the penguin amplitude in this B decay. We search for a pentaquark candidate Theta*++ decaying into pK+ in the mass range 1.43 to 2.00 GeV/c2 and set limits on Br(B+ --> Theta*++pbar)xBr(Theta*++ --> pK+) at the 10^{-7} level.Comment: 8 pages, 7 postscript figures, submitted to Phys. Rev. D (Rapid Communications

The NEWMEDS rodent touchscreen test battery for cognition relevant to schizophrenia.

RATIONALE: The NEWMEDS initiative (Novel Methods leading to New Medications in Depression and Schizophrenia, http://www.newmeds-europe.com ) is a large industrial-academic collaborative project aimed at developing new methods for drug discovery for schizophrenia. As part of this project, Work package 2 (WP02) has developed and validated a comprehensive battery of novel touchscreen tasks for rats and mice for assessing cognitive domains relevant to schizophrenia. OBJECTIVES: This article provides a review of the touchscreen battery of tasks for rats and mice for assessing cognitive domains relevant to schizophrenia and highlights validation data presented in several primary articles in this issue and elsewhere. METHODS: The battery consists of the five-choice serial reaction time task and a novel rodent continuous performance task for measuring attention, a three-stimulus visual reversal and the serial visual reversal task for measuring cognitive flexibility, novel non-matching to sample-based tasks for measuring spatial working memory and paired-associates learning for measuring long-term memory. RESULTS: The rodent (i.e. both rats and mice) touchscreen operant chamber and battery has high translational value across species due to its emphasis on construct as well as face validity. In addition, it offers cognitive profiling of models of diseases with cognitive symptoms (not limited to schizophrenia) through a battery approach, whereby multiple cognitive constructs can be measured using the same apparatus, enabling comparisons of performance across tasks. CONCLUSION: This battery of tests constitutes an extensive tool package for both model characterisation and pre-clinical drug discovery.This work was supported by the Innovative Medicine Initiative Joint Undertaking under grant agreement no. 115008 of which resources are composed of EFPIA in-kind contribution and financial contribution from the European Union’s Seventh Framework Programme (FP7/2007-2013). The authors thank Charlotte Oomen for valuable comments on the manuscript.This is the author accepted manuscript. The final version is available from Springer via http://dx.doi.org/10.1007/s00213-015-4007-