Probabilistic inference for determining options in reinforcement learning

Tasks that require many sequential decisions or complex solutions are hard to solve using conventional reinforcement learning algorithms. Based on the semi Markov decision process setting (SMDP) and the option framework, we propose a model which aims to alleviate these concerns. Instead of learning a single monolithic policy, the agent learns a set of simpler sub-policies as well as the initiation and termination probabilities for each of those sub-policies. While existing option learning algorithms frequently require manual specification of components such as the sub-policies, we present an algorithm which infers all relevant components of the option framework from data. Furthermore, the proposed approach is based on parametric option representations and works well in combination with current policy search methods, which are particularly well suited for continuous real-world tasks. We present results on SMDPs with discrete as well as continuous state-action spaces. The results show that the presented algorithm can combine simple sub-policies to solve complex tasks and can improve learning performance on simpler tasks

New mutations at the imprinted Gnas cluster show gene dosage effects of Gsα in postnatal growth and implicate XLαs in bone and fat metabolism, but not in suckling

The imprinted Gnas cluster is involved in obesity, energy metabolism, feeding behavior, and viability. Relative contribution of paternally expressed proteins XLαs, XLN1, and ALEX or a double dose of maternally expressed Gsα to phenotype has not been established. In this study, we have generated two new mutants (Ex1A-T-CON and Ex1A-T) at the Gnas cluster. Paternal inheritance of Ex1A-T-CON leads to loss of imprinting of Gsα, resulting in preweaning growth retardation followed by catch-up growth. Paternal inheritance of Ex1A-T leads to loss of imprinting of Gsα and loss of expression of XLαs and XLN1. These mice have severe preweaning growth retardation and incomplete catch-up growth. They are fully viable probably because suckling is unimpaired, unlike mutants in which the expression of all the known paternally expressed Gnasxl proteins (XLαs, XLN1 and ALEX) is compromised. We suggest that loss of ALEX is most likely responsible for the suckling defects previously observed. In adults, paternal inheritance of Ex1A-T results in an increased metabolic rate and reductions in fat mass, leptin, and bone mineral density attributable to loss of XLαs. This is, to our knowledge, the first report describing a role for XLαs in bone metabolism. We propose that XLαs is involved in the regulation of bone and adipocyte metabolism

Comparing the immune response to a novel intranasal nanoparticle PLGA vaccine and a commercial BPI3V vaccine in dairy calves

peer-reviewedBackground There is a need to improve vaccination against respiratory pathogens in calves by stimulation of local immunity at the site of pathogen entry at an early stage in life. Ideally such a vaccine preparation would not be inhibited by the maternally derived antibodies. Additionally, localized immune response at the site of infection is also crucial to control infection at the site of entry of virus. The present study investigated the response to an intranasal bovine parainfluenza 3 virus (BPI3V) antigen preparation encapsulated in PLGA (poly dl-lactic-co-glycolide) nanoparticles in the presence of pre-existing anti-BPI3V antibodies in young calves and comparing it to a commercially available BPI3V respiratory vaccine. Results There was a significant (P < 0.05) increase in BPI3V-specific IgA in the nasal mucus of the BPI3V nanoparticle vaccine group alone. Following administration of the nanoparticle vaccine an early immune response was induced that continued to grow until the end of study and was not observed in the other treatment groups. Virus specific serum IgG response to both the nanoparticle vaccine and commercial live attenuated vaccine showed a significant (P < 0.05) rise over the period of study. However, the cell mediated immune response observed didn’t show any significant rise in any of the treatment groups. Conclusion Calves administered the intranasal nanoparticle vaccine induced significantly greater mucosal IgA responses, compared to the other treatment groups. This suggests an enhanced, sustained mucosal-based immunological response to the BPI3V nanoparticle vaccine in the face of pre-existing antibodies to BPI3V, which are encouraging and potentially useful characteristics of a candidate vaccine. However, ability of nanoparticle vaccine in eliciting cell mediated immune response needs further investigation. More sustained local mucosal immunity induced by nanoparticle vaccine has obvious potential if it translates into enhanced protective immunity in the face of virus outbreak

Gentrifying the Peri-urban: Land use Conflicts and institutional dynamics at the Frontier of an Indonesian Metropolis

This paper aims to specify the meaning of gentrification in rapidly peri-urbanising metropolitan regions in the context of Indonesia’s rapid transition to decentralisation and democracy. It discusses a case study of conflict over an environmental revitalisation project in a peri-urban area of Bandung City. The analysis focuses on the political processes, tactics and strategies supporting and opposing peri-urban gentrification and their consequences. The analysis illustrates how these political dynamics mediate the interaction between the movement of capital and the spatial reorganisation of social classes. It is argued that in the context of a peri-urbanising metropolis, gentrification needs to be narrated less in terms of class-based neighbourhood succession and more in terms of competing cross-class coalitions emerging at local and regional levels

Roaring high and low: composition and possible functions of the Iberian stag's vocal repertoire

We provide a detailed description of the rutting vocalisations of free-ranging male Iberian deer (Cervus elaphus hispanicus, Hilzheimer 1909), a geographically isolated and morphologically differentiated subspecies of red deer Cervus elaphus. We combine spectrographic examinations, spectral analyses and automated classifications to identify different call types, and compare the composition of the vocal repertoire with that of other red deer subspecies. Iberian stags give bouts of roars (and more rarely, short series of barks) that are typically composed of two different types of calls. Long Common Roars are mostly given at the beginning or at the end of the bout, and are characterised by a high fundamental frequency (F0) resulting in poorly defined formant frequencies but a relatively high amplitude. In contrast, Short Common Roars are typically given in the middle or at the end of the bout, and are characterised by a lower F0 resulting in relatively well defined vocal tract resonances, but low amplitude. While we did not identify entirely Harsh Roars (as described in the Scottish red deer subspecies (Cervus elaphus scoticus), a small percentage of Long Common Roars contained segments of deterministic chaos. We suggest that the evolution of two clearly distinct types of Common Roars may reflect divergent selection pressures favouring either vocal efficiency in high pitched roars or the communication of body size in low-pitched, high spectral density roars highlighting vocal tract resonances. The clear divergence of the Iberian red deer vocal repertoire from those of other documented European red deer populations reinforces the status of this geographical variant as a distinct subspecies

Search For Heavy Pointlike Dirac Monopoles

We have searched for central production of a pair of photons with high transverse energies in $p\bar p$ collisions at $\sqrt{s} = 1.8$ TeV using $70 pb^{-1}$ of data collected with the D\O detector at the Fermilab Tevatron in 1994--1996. If they exist, virtual heavy pointlike Dirac monopoles could rescatter pairs of nearly real photons into this final state via a box diagram. We observe no excess of events above background, and set lower 95% C.L. limits of $610, 870, or 1580 GeV/c^2$ on the mass of a spin 0, 1/2, or 1 Dirac monopole.Comment: 12 pages, 4 figure

Search for High Mass Photon Pairs in p-pbar --> gamma-gamma-jet-jet Events at sqrt(s)=1.8 TeV

A search has been carried out for events in the channel p-barp --> gamma gamma jet jet. Such a signature can characterize the production of a non-standard Higgs boson together with a W or Z boson. We refer to this non-standard Higgs, having standard model couplings to vector bosons but no coupling to fermions, as a "bosonic Higgs." With the requirement of two high transverse energy photons and two jets, the diphoton mass (m(gamma gamma)) distribution is consistent with expected background. A 90(95)% C.L. upper limit on the cross section as a function of mass is calculated, ranging from 0.60(0.80) pb for m(gamma gamma) = 65 GeV/c^2 to 0.26(0.34) pb for m(gamma gamma) = 150 GeV/c^2, corresponding to a 95% C.L. lower limit on the mass of a bosonic Higgs of 78.5 GeV/c^2.Comment: 9 pages, 3 figures. Replacement has new H->gamma gamma branching ratios and corresponding new mass limit

Measurement of the inclusive and dijet cross-sections of b-jets in pp collisions at sqrt(s) = 7 TeV with the ATLAS detector

The inclusive and dijet production cross-sections have been measured for jets containing b-hadrons (b-jets) in proton-proton collisions at a centre-of-mass energy of sqrt(s) = 7 TeV, using the ATLAS detector at the LHC. The measurements use data corresponding to an integrated luminosity of 34 pb^-1. The b-jets are identified using either a lifetime-based method, where secondary decay vertices of b-hadrons in jets are reconstructed using information from the tracking detectors, or a muon-based method where the presence of a muon is used to identify semileptonic decays of b-hadrons inside jets. The inclusive b-jet cross-section is measured as a function of transverse momentum in the range 20 < pT < 400 GeV and rapidity in the range |y| < 2.1. The bbbar-dijet cross-section is measured as a function of the dijet invariant mass in the range 110 < m_jj < 760 GeV, the azimuthal angle difference between the two jets and the angular variable chi in two dijet mass regions. The results are compared with next-to-leading-order QCD predictions. Good agreement is observed between the measured cross-sections and the predictions obtained using POWHEG + Pythia. MC@NLO + Herwig shows good agreement with the measured bbbar-dijet cross-section. However, it does not reproduce the measured inclusive cross-section well, particularly for central b-jets with large transverse momenta.Comment: 10 pages plus author list (21 pages total), 8 figures, 1 table, final version published in European Physical Journal

Reduced carbon emission estimates from fossil fuel combustion and cement production in China.

Nearly three-quarters of the growth in global carbon emissions from the burning of fossil fuels and cement production between 2010 and 2012 occurred in China. Yet estimates of Chinese emissions remain subject to large uncertainty; inventories of China's total fossil fuel carbon emissions in 2008 differ by 0.3 gigatonnes of carbon, or 15 per cent. The primary sources of this uncertainty are conflicting estimates of energy consumption and emission factors, the latter being uncertain because of very few actual measurements representative of the mix of Chinese fuels. Here we re-evaluate China's carbon emissions using updated and harmonized energy consumption and clinker production data and two new and comprehensive sets of measured emission factors for Chinese coal. We find that total energy consumption in China was 10 per cent higher in 2000-2012 than the value reported by China's national statistics, that emission factors for Chinese coal are on average 40 per cent lower than the default values recommended by the Intergovernmental Panel on Climate Change, and that emissions from China's cement production are 45 per cent less than recent estimates. Altogether, our revised estimate of China's CO2 emissions from fossil fuel combustion and cement production is 2.49 gigatonnes of carbon (2 standard deviations = ±7.3 per cent) in 2013, which is 14 per cent lower than the emissions reported by other prominent inventories. Over the full period 2000 to 2013, our revised estimates are 2.9 gigatonnes of carbon less than previous estimates of China's cumulative carbon emissions. Our findings suggest that overestimation of China's emissions in 2000-2013 may be larger than China's estimated total forest sink in 1990-2007 (2.66 gigatonnes of carbon) or China's land carbon sink in 2000-2009 (2.6 gigatonnes of carbon).This is the author accepted manuscript. The final version is available from NPG via http://dx.doi.org/10.1038/nature1467

Ratio of the Isolated Photon Cross Sections at \sqrt{s} = 630 and 1800 GeV

The inclusive cross section for production of isolated photons has been measured in \pbarp collisions at $\sqrt{s} = 630$ GeV with the \D0 detector at the Fermilab Tevatron Collider. The photons span a transverse energy ($E_T$) range from 7-49 GeV and have pseudorapidity $|\eta| < 2.5$. This measurement is combined with to previous \D0 result at $\sqrt{s} = 1800$ GeV to form a ratio of the cross sections. Comparison of next-to-leading order QCD with the measured cross section at 630 GeV and ratio of cross sections show satisfactory agreement in most of the $E_T$ range.Comment: 7 pages. Published in Phys. Rev. Lett. 87, 251805, (2001