Retrospective model-based inference guides model-free credit assignment

An extensive reinforcement learning literature shows that organisms assign credit efficiently, even under conditions of state uncertainty. However, little is known about credit-assignment when state uncertainty is subsequently resolved. Here, we address this problem within the framework of an interaction between model-free (MF) and model-based (MB) control systems. We present and support experimentally a theory of MB retrospective-inference. Within this framework, a MB system resolves uncertainty that prevailed when actions were taken thus guiding an MF credit-assignment. Using a task in which there was initial uncertainty about the lotteries that were chosen, we found that when participants’ momentary uncertainty about which lottery had generated an outcome was resolved by provision of subsequent information, participants preferentially assigned credit within a MF system to the lottery they retrospectively inferred was responsible for this outcome. These findings extend our knowledge about the range of MB functions and the scope of system interactions

Pulmonary Predictors of Incident Diabetes in Smokers.

BACKGROUND: Diabetes mellitus and its complications are a large and increasing burden for health care worldwide. Reduced pulmonary function has been observed in diabetes (both type 1 and type 2), and this reduction is thought to occur prior to diagnosis. Other measures of pulmonary health are associated with diabetes, including lower exercise tolerance, greater dyspnea, lower quality of life (as measured by the St. George's Respiratory Questionaire [SGRQ]) and susceptibility to lung infection and these measures may also predate diabetes diagnosis. METHODS: We examined 7080 participants in the COPD Genetic Epidemiology (COPDGene) study who did not report diabetes at their baseline visit and who provided health status updates during 4.2 years of longitudinal follow-up (LFU). We used Cox proportional hazards modeling, censoring participants at final LFU contact, reported mortality or report of incident diabetes to model predictors of diabetes. These models were constructed using known risk factors as well as proposed markers related to pulmonary health, forced expiratory volume in 1 second (FEV1), forced vital capacity (FVC), FEV1/FVC, respiratory exacerbations (RE), 6-minute walk distance (6MWD), pulmonary associated quality of life (as measured by the SGRQ), corticosteroid use, chronic bronchitis and dyspnea. RESULTS: Over 21,519 person years of follow-up, 392 of 7080 participants reported incident diabetes which was associated with expected predictors; increased body mass index (BMI), high blood pressure, high cholesterol and current smoking status. Age, gender and accumulated smoking exposure were not associated with incident diabetes. Additionally, preserved ratio with impaired spirometry (PRISm) pattern pulmonary function, reduced 6MWD and any report of serious pulmonary events were associated with incident diabetes. CONCLUSIONS: This cluster of pulmonary indicators may aid clinicians in identifying and treating patients with pre- or undiagnosed diabetes

Influence of SIGLEC9 polymorphisms on COPD phenotypes including exacerbation frequency.

BACKGROUND AND OBJECTIVE: The exacerbation-prone phenotype of COPD is particularly important, as exacerbations lead to poor quality of life and disease progression. We previously found that COPD patients who lack Siglec-14, a myeloid cell protein that recognizes bacteria and triggers inflammatory responses, are less prone to exacerbation. We hypothesized that the variations in other SIGLEC genes could also influence COPD exacerbation frequency, and investigated the association between SIGLEC9 polymorphisms and the exacerbation-prone phenotype of COPD. METHODS: We examined whether SIGLEC9 polymorphisms affect the frequency of COPD exacerbation in 135 subjects within our study population, and also analysed the correlation between the genotypes and the severity of airflow obstruction and emphysema in 362 Japanese smokers including 244 COPD patients. The association between these single nucleotide polymorphisms (SNPs) and COPD phenotypes were also assessed in a Caucasian population of ECLIPSE study. The effects of these coding SNPs (cSNPs) on Siglec-9 protein functions were analysed using in vitro assays. RESULTS: The G allele of rs2075803 and rs2075803 G/rs2258983 A(GA) haplotype in SIGLEC9 was associated with higher frequency of exacerbations and the extent of emphysema in COPD. These results did not replicate in the ECLIPSE study. A myeloid cell line expressing the Siglec-9 variant corresponding to GA haplotype produced more TNF-α than the one expressing the variant corresponding to the other major haplotype. CONCLUSION: The SIGLEC9 rs2075803 G/rs2258983 A haplotype, which corresponds to a Siglec-9 variant that is less effective at suppressing inflammatory response, may be a risk factor for the development of emphysema

Multiple ITS Copies Reveal Extensive Hybridization within Rheum (Polygonaceae), a Genus That Has Undergone Rapid Radiation

During adaptive radiation events, characters can arise multiple times due to parallel evolution, but transfer of traits through hybridization provides an alternative explanation for the same character appearing in apparently non-sister lineages. The signature of hybridization can be detected in incongruence between phylogenies derived from different markers, or from the presence of two divergent versions of a nuclear marker such as ITS within one individual.In this study, we cloned and sequenced ITS regions for 30 species of the genus Rheum, and compared them with a cpDNA phylogeny. Seven species contained two divergent copies of ITS that resolved in different clades from one another in each case, indicating hybridization events too recent for concerted evolution to have homogenised the ITS sequences. Hybridization was also indicated in at least two further species via incongruence in their position between ITS and cpDNA phylogenies. None of the ITS sequences present in these nine species matched those detected in any other species, which provides tentative evidence against recent introgression as an explanation. Rheum globulosum, previously indicated by cpDNA to represent an independent origin of decumbent habit, is indicated by ITS to be part of clade of decumbent species, which acquired cpDNA of another clade via hybridization. However decumbent and glasshouse morphology are confirmed to have arisen three and two times, respectively.These findings suggested that hybridization among QTP species of Rheum has been extensive, and that a role of hybridization in diversification of Rheum requires investigation

Differences in smoking associated DNA methylation patterns in South Asians and Europeans

This is a freely-available open access publication. Please cite the published version which is available via the DOI link in this record.Background DNA methylation is strongly associated with smoking status at multiple sites across the genome. Studies have largely been restricted to European origin individuals yet the greatest increase in smoking is occurring in low income countries, such as the Indian subcontinent. We determined whether there are differences between South Asians and Europeans in smoking related loci, and if a smoking score, combining all smoking related DNA methylation scores, could differentiate smokers from non-smokers. Results Illumina HM450k BeadChip arrays were performed on 192 samples from the Southall And Brent REvisited (SABRE) cohort. Differential methylation in smokers was identified in 29 individual CpG sites at 18 unique loci. Interaction between smoking status and ethnic group was identified at the AHRR locus. Ethnic differences in DNA methylation were identified in non-smokers at two further loci, 6p21.33 and GNG12. With the exception of GFI1 and MYO1G these differences were largely unaffected by adjustment for cell composition. A smoking score based on methylation profile was constructed. Current smokers were identified with 100% sensitivity and 97% specificity in Europeans and with 80% sensitivity and 95% specificity in South Asians. Conclusions Differences in ethnic groups were identified in both single CpG sites and combined smoking score. The smoking score is a valuable tool for identification of true current smoking behaviour. Explanations for ethnic differences in DNA methylation in association with smoking may provide valuable clues to disease pathways.Wellcome Trust Enhancement grantMedical Research CouncilDiabetes UKthe British Heart Foundatio

Optogenetic control of Drosophila using a red-shifted channelrhodopsin reveals experience-dependent influences on courtship

Optogenetics allows the manipulation of neural activity in freely moving animals with millisecond precision, but its application in Drosophila melanogaster has been limited. Here we show that a recently described red activatable channelrhodopsin (ReaChR) permits control of complex behavior in freely moving adult flies, at wavelengths that are not thought to interfere with normal visual function. This tool affords the opportunity to control neural activity over a broad dynamic range of stimulation intensities. Using time-resolved activation, we show that the neural control of male courtship song can be separated into (i) probabilistic, persistent and (ii) deterministic, command-like components. The former, but not the latter, neurons are subject to functional modulation by social experience, which supports the idea that they constitute a locus of state-dependent influence. This separation is not evident using thermogenetic tools, a result underscoring the importance of temporally precise control of neuronal activation in the functional dissection of neural circuits in Drosophila

Voice cues are used in a similar way by blind and sighted adults when assessing women’s body size

Humans’ ability to gauge another person’s body size from their voice alone may serve multiple functions ranging from threat assessment to speaker normalization. However, how this ability is acquired remains unknown. In two experiments we tested whether sighted, congenitally blind and late blind adults could accurately judge the relative heights of women from paired voice stimuli, and importantly, whether errors in size estimation varied with task difficulty across groups. Both blind (n = 56) and sighted (n = 61) listeners correctly judged women’s relative heights on approximately 70% of low difficulty trials, corroborating previous findings for judging men’s heights. However, accuracy dropped to chance levels for intermediate difficulty trials and to 25% for high difficulty trials, regardless of the listener’s sightedness, duration of vision loss, sex, or age. Thus, blind adults estimated women’s height with the same degree of accuracy, but also the same pattern of errors, as did sighted controls. Our findings provide further evidence that visual experience is not necessary for accurate body size estimation. Rather, both blind and sighted listeners appear to follow a general rule, mapping low auditory frequencies to largeness across a range of contexts. This sound-size mapping emerges without visual experience, and is likely very important for humans

Competition and habitat quality influence age and sex distribution in wintering rusty blackbirds.

Bird habitat quality is often inferred from species abundance measures during the breeding and non-breeding season and used for conservation management decisions. However, during the non-breeding season age and sex classes often occupy different habitats which suggest a need for more habitat-specific data. Rusty Blackbird (Euphagus carolinus) is a forested wetland specialist wintering in bottomland hardwood forests in the south-eastern U. S. and belongs to the most steeply declining songbirds in the U.S. Little information is available to support priority birds such as the Rusty Blackbird wintering in this threatened habitat. We assessed age and sex distribution and body condition of Rusty Blackbirds among the three major habitats used by this species in the Lower Mississippi Alluvial Valley and also measured food availability. Overall, pecan groves had the highest biomass mainly driven by the amount of nuts. Invertebrate biomass was highest in forests but contributed only a small percentage to overall biomass. Age and sex classes were unevenly distributed among habitats with adult males primarily occupying pecan groves containing the highest nut biomass, females being found in forests which had the lowest nut biomass and young males primarily staying in forest fragments along creeks which had intermediate nut biomass. Males were in better body condition than females and were in slightly better condition in pecan groves. The results suggest that adult males occupy the highest quality habitat and may competitively exclude the other age and sex classes

Expected health benefits of SGLT-2 inhibitors and GLP-1 receptor agonists in older adults

Background. Older and sicker adults with type 2 diabetes (T2D) were underrepresented in randomized trials of glucagon-like peptide 1 receptor-agonist (GLP1RA) and sodium-glucose cotransporter 2 inhibitors (SGLT2I), and thus, health benefits are uncertain in this population. Objective. To assess the impact of age, health status, and life expectancy in older adults with T2D on health benefits of GLP1RA and SGLT2I. Design. We used the United Kingdom Prospective Diabetes Study (UKPDS) model to simulate lifetime health outcomes. We calibrated the UKPDS model to improve mortality prediction in older adults using a common geriatric prognostic index. Participants. National Health and Nutrition Examination Survey 2013–2018 participants 65 y and older with T2D, eligible for GLP1RA or SGLT2I according to American Diabetes Association guidelines. Interventions. GLP1RA or SGLT2I use versus no additional medication. Main Measures. Lifetime complications and weighted life-years (LYs) and quality-adjusted life-years (QALYs) across overall treatment arms and life expectancies. Key Results. The overall older adult population was predicted to experience significant health benefits from GLP1RA (+0.29 LY [95% confidence interval: 0.27, 0.31], +0.15 QALYs [0.14, 0.16]) and SGLT2I (+0.26 LY [0.24, 0.28], +0.13 QALYs [0.12, 0.14]) as compared with no added medication. However, expected benefits declined in subgroups with shorter life expectancies. Participants with <4 y of life expectancy had minimal gains of <0.05 LY and <0.03 QALYs from added medication. Accounting for injection-related disutility, GLP1RA use reduced QALYs (−0.03 QALYs [−0.04, −0.02]). Conclusions. While GLP1RA and SGLT2I have substantial health benefits for many older adults with type 2 diabetes, benefits are not clinically significant in patients with <4 y of life expectancy. Life expectancy and patient preferences are important considerations when prescribing newer diabetes medications

Prepatterning in the Stem Cell Compartment

The mechanism by which an apparently uniform population of cells can generate a heterogeneous population of differentiated derivatives is a fundamental aspect of pluripotent and multipotent stem cell behaviour. One possibility is that the environment and the differentiation cues to which the cells are exposed are not uniform. An alternative, but not mutually exclusive possibility is that the observed heterogeneity arises from the stem cells themselves through the existence of different interconvertible substates that pre-exist before the cells commit to differentiate. We have tested this hypothesis in the case of apparently homogeneous pluripotent human embryonal carcinoma (EC) stem cells, which do not follow a uniform pattern of differentiation when exposed to retinoic acid. Instead, they produce differentiated progeny that include both neuronal and non-neural phenotypes. Our results suggest that pluripotent NTERA2 stem cells oscillate between functionally distinct substates that are primed to select distinct lineages when differentiation is induced