Retrospective model-based inference guides model-free credit assignment

An extensive reinforcement learning literature shows that organisms assign credit efficiently, even under conditions of state uncertainty. However, little is known about credit-assignment when state uncertainty is subsequently resolved. Here, we address this problem within the framework of an interaction between model-free (MF) and model-based (MB) control systems. We present and support experimentally a theory of MB retrospective-inference. Within this framework, a MB system resolves uncertainty that prevailed when actions were taken thus guiding an MF credit-assignment. Using a task in which there was initial uncertainty about the lotteries that were chosen, we found that when participants’ momentary uncertainty about which lottery had generated an outcome was resolved by provision of subsequent information, participants preferentially assigned credit within a MF system to the lottery they retrospectively inferred was responsible for this outcome. These findings extend our knowledge about the range of MB functions and the scope of system interactions

Shock waves in strongly coupled plasmas

Shock waves are supersonic disturbances propagating in a fluid and giving rise to dissipation and drag. Weak shocks, i.e., those of small amplitude, can be well described within the hydrodynamic approximation. On the other hand, strong shocks are discontinuous within hydrodynamics and therefore probe the microscopics of the theory. In this paper we consider the case of the strongly coupled N=4 plasma whose microscopic description, applicable for scales smaller than the inverse temperature, is given in terms of gravity in an asymptotically $AdS_5$ space. In the gravity approximation, weak and strong shocks should be described by smooth metrics with no discontinuities. For weak shocks we find the dual metric in a derivative expansion and for strong shocks we use linearized gravity to find the exponential tail that determines the width of the shock. In particular we find that, when the velocity of the fluid relative to the shock approaches the speed of light $v\to 1$ the penetration depth $\ell$ scales as $\ell\sim (1-v^2)^{1/4}$. We compare the results with second order hydrodynamics and the Israel-Stewart approximation. Although they all agree in the hydrodynamic regime of weak shocks, we show that there is not even qualitative agreement for strong shocks. For the gravity side, the existence of shock waves implies that there are disturbances of constant shape propagating on the horizon of the dual black holes.Comment: 47 pages, 8 figures; v2:typos corrected, references adde

Early MicroRNA expression profile as a prognostic biomarker for the development of pelvic inflammatory disease in a mouse model of chlamydial genital infection

It is not currently possible to predict the probability of whether a woman with a chlamydial genital infection will develop pelvic inflammatory disease (PID). To determine if specific biomarkers may be associated with distinct chlamydial pathotypes, we utilized two Chlamydia muridarum variants (C. muridarum Var001 [CmVar001] and CmVar004) that differ in their abilities to elicit upper genital tract pathology in a mouse model. CmVar004 has a lower growth rate in vitro and induces pathology in only 20% of C57BL/6 mouse oviducts versus 83.3% of oviducts in CmVar001-infected mice. To determine if chemokine and cytokine production within 24 h of infection is associated with the outcome of pathology, levels of 15 chemokines and cytokines were measured. CmVar004 infection induced significantly lower levels of CXCL1, CXCL2, tumor necrosis factor alpha (TNF-α), and CCL2 in comparison to CmVar001 infection with similar rRNA (rs16) levels for Chlamydiae. A combination of microRNA (miRNA) sequencing and quantitative real-time PCR (qRT-PCR) analysis of 134 inflammation-related miRNAs was performed 24 h postinfection to determine if the chemokine/cytokine responses would also be reflected in miRNA expression profiles. Interestingly, 12 miRNAs (miR-135a-5p, miR298-5p, miR142-3p, miR223-3p, miR299a-3p, miR147-3p, miR105, miR325-3p, miR132-3p, miR142-5p, miR155-5p, and miR-410-3p) were overexpressed during CmVar004 infection compared to CmVar001 infection, inversely correlating with the respective chemokine/cytokine responses. To our knowledge, this is the first report demonstrating that early biomarkers elicited in the host can differentiate between two pathological variants of chlamydiae and be predictive of upper tract disease. © 2014 Yeruva et al

The particle number in Galilean holography

Recently, gravity duals for certain Galilean-invariant conformal field theories have been constructed. In this paper, we point out that the spectrum of the particle number operator in the examples found so far is not a necessary consequence of the existence of a gravity dual. We record some progress towards more realistic spectra. In particular, we construct bulk systems with asymptotic Schrodinger symmetry and only one extra dimension. In examples, we find solutions which describe these Schrodinger-symmetric systems at finite density. A lift to M-theory is used to resolve a curvature singularity. As a happy byproduct of this analysis, we realize a state which could be called a holographic Mott insulator.Comment: 29 pages, 1 rudimentary figure; v2: typo in eqn (3.4), added comments and ref

Strong signature of natural selection within an FHIT intron implicated in prostate cancer risk

Previously, a candidate gene linkage approach on brother pairs affected with prostate cancer identified a locus of prostate cancer susceptibility at D3S1234 within the fragile histidine triad gene (FHIT), a tumor suppressor that induces apoptosis. Subsequent association tests on 16 SNPs spanning approximately 381 kb surrounding D3S1234 in Americans of European descent revealed significant evidence of association for a single SNP within intron 5 of FHIT. In the current study, resequencing and genotyping within a 28.5 kb region surrounding this SNP further delineated the association with prostate cancer risk to a 15 kb region. Multiple SNPs in sequences under evolutionary constraint within intron 5 of FHIT defined several related haplotypes with an increased risk of prostate cancer in European-Americans. Strong associations were detected for a risk haplotype defined by SNPs 138543, 142413, and 152494 in all cases (Pearson's χ2 = 12.34, df 1, P = 0.00045) and for the homozygous risk haplotype defined by SNPs 144716, 142413, and 148444 in cases that shared 2 alleles identical by descent with their affected brothers (Pearson's χ2 = 11.50, df 1, P = 0.00070). In addition to highly conserved sequences encompassing SNPs 148444 and 152413, population studies revealed strong signatures of natural selection for a 1 kb window covering the SNP 144716 in two human populations, the European American (π = 0.0072, Tajima's D= 3.31, 14 SNPs) and the Japanese (π = 0.0049, Fay & Wu's H = 8.05, 14 SNPs), as well as in chimpanzees (Fay & Wu's H = 8.62, 12 SNPs). These results strongly support the involvement of the FHIT intronic region in an increased risk of prostate cancer. © 2008 Ding et al

Unexpectedly rapid evolution of mandibular shape in hominins

Members of the hominins – namely the so-called ‘australopiths’ and the species of the genus Homo – are known to possess short and deep mandibles and relatively small incisors and canines. It is commonly assumed that this suite of traits evolved in early members of the clade in response to changing environmental conditions and increased consumption of though food items. With the emergence of Homo, the functional meaning of mandible shape variation is thought to have been weakened by technological advancements and (later) by the control over fire. In contrast to this expectation, we found that mandible shape evolution in hominins is exceptionally rapid as compared to any other primate clade, and that the direction and rate of shape change (from the ape ancestor) are no different between the australopiths and Homo. We deem several factors including the loss of honing complex, canine reduction, and the acquisition of different diets may have concurred in producing such surprisingly high evolutionary rates. This study reveals the evolution of mandibular shape in hominins has strong morpho-functional and ecological significance attached

Measurement of the inclusive and dijet cross-sections of b-jets in pp collisions at sqrt(s) = 7 TeV with the ATLAS detector

The inclusive and dijet production cross-sections have been measured for jets containing b-hadrons (b-jets) in proton-proton collisions at a centre-of-mass energy of sqrt(s) = 7 TeV, using the ATLAS detector at the LHC. The measurements use data corresponding to an integrated luminosity of 34 pb^-1. The b-jets are identified using either a lifetime-based method, where secondary decay vertices of b-hadrons in jets are reconstructed using information from the tracking detectors, or a muon-based method where the presence of a muon is used to identify semileptonic decays of b-hadrons inside jets. The inclusive b-jet cross-section is measured as a function of transverse momentum in the range 20 < pT < 400 GeV and rapidity in the range |y| < 2.1. The bbbar-dijet cross-section is measured as a function of the dijet invariant mass in the range 110 < m_jj < 760 GeV, the azimuthal angle difference between the two jets and the angular variable chi in two dijet mass regions. The results are compared with next-to-leading-order QCD predictions. Good agreement is observed between the measured cross-sections and the predictions obtained using POWHEG + Pythia. MC@NLO + Herwig shows good agreement with the measured bbbar-dijet cross-section. However, it does not reproduce the measured inclusive cross-section well, particularly for central b-jets with large transverse momenta.Comment: 10 pages plus author list (21 pages total), 8 figures, 1 table, final version published in European Physical Journal