3,718 research outputs found

    Planning with Information-Processing Constraints and Model Uncertainty in Markov Decision Processes

    Full text link
    Information-theoretic principles for learning and acting have been proposed to solve particular classes of Markov Decision Problems. Mathematically, such approaches are governed by a variational free energy principle and allow solving MDP planning problems with information-processing constraints expressed in terms of a Kullback-Leibler divergence with respect to a reference distribution. Here we consider a generalization of such MDP planners by taking model uncertainty into account. As model uncertainty can also be formalized as an information-processing constraint, we can derive a unified solution from a single generalized variational principle. We provide a generalized value iteration scheme together with a convergence proof. As limit cases, this generalized scheme includes standard value iteration with a known model, Bayesian MDP planning, and robust planning. We demonstrate the benefits of this approach in a grid world simulation.Comment: 16 pages, 3 figure

    Children and older adults exhibit distinct sub-optimal cost-benefit functions when preparing to move their eyes and hands

    Get PDF
    "© 2015 Gonzalez et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited"Numerous activities require an individual to respond quickly to the correct stimulus. The provision of advance information allows response priming but heightened responses can cause errors (responding too early or reacting to the wrong stimulus). Thus, a balance is required between the online cognitive mechanisms (inhibitory and anticipatory) used to prepare and execute a motor response at the appropriate time. We investigated the use of advance information in 71 participants across four different age groups: (i) children, (ii) young adults, (iii) middle-aged adults, and (iv) older adults. We implemented 'cued' and 'non-cued' conditions to assess age-related changes in saccadic and touch responses to targets in three movement conditions: (a) Eyes only; (b) Hands only; (c) Eyes and Hand. Children made less saccade errors compared to young adults, but they also exhibited longer response times in cued versus non-cued conditions. In contrast, older adults showed faster responses in cued conditions but exhibited more errors. The results indicate that young adults (18 -25 years) achieve an optimal balance between anticipation and execution. In contrast, children show benefits (few errors) and costs (slow responses) of good inhibition when preparing a motor response based on advance information; whilst older adults show the benefits and costs associated with a prospective response strategy (i.e., good anticipation)

    Oxy-fuel combustion of coal and biomass blends

    Get PDF
    The ignition temperature, burnout and NO emissions of blends of a semi-anthracite and a high-volatile bituminous coal with 10 and 20 wt.% of olive waste were studied under oxy-fuel combustion conditions in an entrained flow reactor (EFR). The results obtained under several oxy-fuel atmospheres (21%O2–79%CO2, 30%O2–70%CO2 and 35%O2–65%CO2) were compared with those attained in air. The results indicated that replacing N2 by CO2 in the combustion atmosphere with 21% of O2 caused an increase in the temperature of ignition and a decrease in the burnout value. When the O2 concentration was increased to 30 and 35%, the temperature of ignition was lower and the burnout value was higher than in air conditions. A significant reduction in ignition temperature and a slight increase in the burnout value was observed after the addition of biomass, this trend becoming more noticeable as the biomass concentration was increased. The emissions of NO during oxy-fuel combustion were lower than under air-firing. However, they remained similar under all the oxy-fuel atmospheres with increasing O2 concentrations. Emissions of NO were significantly reduced by the addition of biomass to the bituminous coal, although this effect was less noticeable in the case of the semi-anthracite.This work was carried out with financial support from the Spanish MICINN (Project PS-120000-2005-2) co-financed by the European Regional Development Fund. M.V.G. and L.A. acknowledge funding from the CSIC JAE-Doc and CSIC JAE-Pre programs, respectively, co-financed by the European Social Fund. J.R. acknowledges funding from the Government of the Principado de Asturias (Severo Ochoa program).Peer reviewe

    Genome-wide linkage analysis of 972 bipolar pedigrees using single-nucleotide polymorphisms.

    Get PDF
    Because of the high costs associated with ascertainment of families, most linkage studies of Bipolar I disorder (BPI) have used relatively small samples. Moreover, the genetic information content reported in most studies has been less than 0.6. Although microsatellite markers spaced every 10 cM typically extract most of the genetic information content for larger multiplex families, they can be less informative for smaller pedigrees especially for affected sib pair kindreds. For these reasons we collaborated to pool family resources and carried out higher density genotyping. Approximately 1100 pedigrees of European ancestry were initially selected for study and were genotyped by the Center for Inherited Disease Research using the Illumina Linkage Panel 12 set of 6090 single-nucleotide polymorphisms. Of the ~1100 families, 972 were informative for further analyses, and mean information content was 0.86 after pruning for linkage disequilibrium. The 972 kindreds include 2284 cases of BPI disorder, 498 individuals with bipolar II disorder (BPII) and 702 subjects with recurrent major depression. Three affection status models (ASMs) were considered: ASM1 (BPI and schizoaffective disorder, BP cases (SABP) only), ASM2 (ASM1 cases plus BPII) and ASM3 (ASM2 cases plus recurrent major depression). Both parametric and non-parametric linkage methods were carried out. The strongest findings occurred at 6q21 (non-parametric pairs LOD 3.4 for rs1046943 at 119 cM) and 9q21 (non-parametric pairs logarithm of odds (LOD) 3.4 for rs722642 at 78 cM) using only BPI and schizoaffective (SA), BP cases. Both results met genome-wide significant criteria, although neither was significant after correction for multiple analyses. We also inspected parametric scores for the larger multiplex families to identify possible rare susceptibility loci. In this analysis, we observed 59 parametric LODs of 2 or greater, many of which are likely to be close to maximum possible scores. Although some linkage findings may be false positives, the results could help prioritize the search for rare variants using whole exome or genome sequencing

    Sri Lankan tsunami refugees: a cross sectional study of the relationships between housing conditions and self-reported health

    Get PDF
    BACKGROUND: On the 26th December 2004 the Asian tsunami devastated the Sri Lankan coastline. More than two years later, over 14,500 families were still living in transitional shelters. This study compares the health of the internally displaced people (IDP), living in transitional camps with those in permanent housing projects provided by government and non-government organisations in Sri Lanka. METHODS: This study was conducted in seven transitional camps and five permanent housing projects in the south west of Sri Lanka. Using an interviewer-led questionnaire, data on the IDPs' self-reported health and housing conditions were collected from 154 participants from transitional camps and 147 participants from permanent housing projects. Simple tabulation with non-parametric tests and logistic regression were used to identify and analyse relationships between housing conditions and the reported prevalence of specific symptoms. RESULTS: Analysis showed that living conditions were significantly worse in transitional camps than in permanent housing projects for all factors investigated, except 'having a leaking roof'. Transitional camp participants scored significantly lower on self-perceived overall health scores than those living in housing projects. After controlling for gender, age and marital status, living in a transitional camp compared to a housing project was found to be a significant risk factor for the following symptoms; coughs OR: 3.53 (CI: 2.11-5.89), stomach ache 4.82 (2.19-10.82), headache 5.20 (3.09-8.76), general aches and pains 6.44 (3.67-11.33) and feeling generally unwell 2.28 (2.51-7.29). Within transitional camp data, the only condition shown to be a significant risk factor for any symptom was household population density, which increased the risk of stomach aches 1.40 (1.09-1.79) and headaches 1.33 (1.01-1.77). CONCLUSION: Internally displaced people living in transitional camps are a vulnerable population and specific interventions need to be targeted at this population to address the health inequalities that they report to be experiencing. Further studies need to be conducted to establish which aspects of their housing environment predispose them to poorer health

    Altered Neurocircuitry in the Dopamine Transporter Knockout Mouse Brain

    Get PDF
    The plasma membrane transporters for the monoamine neurotransmitters dopamine, serotonin, and norepinephrine modulate the dynamics of these monoamine neurotransmitters. Thus, activity of these transporters has significant consequences for monoamine activity throughout the brain and for a number of neurological and psychiatric disorders. Gene knockout (KO) mice that reduce or eliminate expression of each of these monoamine transporters have provided a wealth of new information about the function of these proteins at molecular, physiological and behavioral levels. In the present work we use the unique properties of magnetic resonance imaging (MRI) to probe the effects of altered dopaminergic dynamics on meso-scale neuronal circuitry and overall brain morphology, since changes at these levels of organization might help to account for some of the extensive pharmacological and behavioral differences observed in dopamine transporter (DAT) KO mice. Despite the smaller size of these animals, voxel-wise statistical comparison of high resolution structural MR images indicated little morphological change as a consequence of DAT KO. Likewise, proton magnetic resonance spectra recorded in the striatum indicated no significant changes in detectable metabolite concentrations between DAT KO and wild-type (WT) mice. In contrast, alterations in the circuitry from the prefrontal cortex to the mesocortical limbic system, an important brain component intimately tied to function of mesolimbic/mesocortical dopamine reward pathways, were revealed by manganese-enhanced MRI (MEMRI). Analysis of co-registered MEMRI images taken over the 26 hours after introduction of Mn^(2+) into the prefrontal cortex indicated that DAT KO mice have a truncated Mn^(2+) distribution within this circuitry with little accumulation beyond the thalamus or contralateral to the injection site. By contrast, WT littermates exhibit Mn^(2+) transport into more posterior midbrain nuclei and contralateral mesolimbic structures at 26 hr post-injection. Thus, DAT KO mice appear, at this level of anatomic resolution, to have preserved cortico-striatal-thalamic connectivity but diminished robustness of reward-modulating circuitry distal to the thalamus. This is in contradistinction to the state of this circuitry in serotonin transporter KO mice where we observed more robust connectivity in more posterior brain regions using methods identical to those employed here

    Analytic philosophy for biomedical research: the imperative of applying yesterday's timeless messages to today's impasses

    Get PDF
    The mantra that "the best way to predict the future is to invent it" (attributed to the computer scientist Alan Kay) exemplifies some of the expectations from the technical and innovative sides of biomedical research at present. However, for technical advancements to make real impacts both on patient health and genuine scientific understanding, quite a number of lingering challenges facing the entire spectrum from protein biology all the way to randomized controlled trials should start to be overcome. The proposal in this chapter is that philosophy is essential in this process. By reviewing select examples from the history of science and philosophy, disciplines which were indistinguishable until the mid-nineteenth century, I argue that progress toward the many impasses in biomedicine can be achieved by emphasizing theoretical work (in the true sense of the word 'theory') as a vital foundation for experimental biology. Furthermore, a philosophical biology program that could provide a framework for theoretical investigations is outlined

    Obesity Indexes and Total Mortality among Elderly Subjects at High Cardiovascular Risk: The PREDIMED Study

    Get PDF
    BackgroundDifferent indexes of regional adiposity have been proposed for identifying persons at higher risk of death. Studies specifically assessing these indexes in large cohorts are scarce. It would also be interesting to know whether a dietary intervention may counterbalance the adverse effects of adiposity on mortality.MethodsWe assessed the association of four different anthropometric indexes (waist-to-height ratio (WHtR), waist circumference (WC), body mass index (BMI) and height) with all-cause mortality in 7447 participants at high cardiovascular risk from the PREDIMED trial. Forty three percent of them were men (55 to 80 years) and 57% were women (60 to 80 years). All of them were initially free of cardiovascular disease. The recruitment took place in 11 recruiting centers between 2003 and 2009.ResultsAfter adjusting for age, sex, smoking, diabetes, hypertension, intervention group, family history of coronary heart disease, and leisure-time physical activity, WC and WHtR were found to be directly associated with a higher mortality after 4.8 years median follow-up. The multivariable-adjusted HRs for mortality of WHtR (cut-off points: 0.60, 0.65, 0.70) were 1.02 (0.78–1.34), 1.30 (0.97–1.75) and 1.55 (1.06–2.26). When we used WC (cut-off points: 100, 105 and 110 cm), the multivariable adjusted Hazard Ratios (HRs) for mortality were 1.18 (0.88–1.59), 1.02 (0.74–1.41) and 1.57 (1.19–2.08). In all analyses, BMI exhibited weaker associations with mortality than WC or WHtR. The direct association between WHtR and overall mortality was consistent within each of the three intervention arms of the trial.ConclusionsOur study adds further support to a stronger association of abdominal obesity than BMI with total mortality among elderly subjects at high risk of cardiovascular disease. We did not find evidence to support that the PREDIMED intervention was able to counterbalance the harmful effects of increased adiposity on total mortality.Trial RegistrationControlled-Trials.com ISRCTN3573963
    corecore