Bandit Models of Human Behavior: Reward Processing in Mental Disorders

Drawing an inspiration from behavioral studies of human decision making, we propose here a general parametric framework for multi-armed bandit problem, which extends the standard Thompson Sampling approach to incorporate reward processing biases associated with several neurological and psychiatric conditions, including Parkinson's and Alzheimer's diseases, attention-deficit/hyperactivity disorder (ADHD), addiction, and chronic pain. We demonstrate empirically that the proposed parametric approach can often outperform the baseline Thompson Sampling on a variety of datasets. Moreover, from the behavioral modeling perspective, our parametric framework can be viewed as a first step towards a unifying computational model capturing reward processing abnormalities across multiple mental conditions.Comment: Conference on Artificial General Intelligence, AGI-1

Towards a computational psychiatry of juvenile obsessive-compulsive disorder

Obsessive-Compulsive Disorder (OCD) most often emerges during adolescence, but we know little about the aberrant neural and cognitive developmental mechanisms that underlie its emergence during this critical developmental period. To move towards a computational psychiatry of juvenile OCD, we review studies on the computational, neuropsychological and neural alterations in juvenile OCD and link these findings to the adult OCD and cognitive neuroscience literature. We find consistent difficulties in tasks entailing complex decision making and set shifting, but limited evidence in other areas that are altered in adult OCD, such as habit and confidence formation. Based on these findings, we establish a neurocomputational framework that illustrates how cognition can go awry and lead to symptoms of juvenile OCD. We link these possible aberrant neural processes to neuroimaging findings in juvenile OCD and show that juvenile OCD is mainly characterised by disruptions of complex reasoning systems

How does cognitive load influence speech perception? : An encoding hypothesis

Two experiments investigated the conditions under which cognitive load exerts an effect on speech perception. These experiments extend earlier research by using a different speech perception task (four-interval oddity task) and by implementing cognitive load through a task often thought to be modular, namely, face processing. In the cognitive-load conditions, participants were required to remember two faces presented before the speech stimuli. In Experiment 1, performance in the speech-perception task under cognitive load was not impaired in comparison to a no-load baseline condition. In Experiment 2, we modified the load condition minimally such that it required encoding of the two faces simultaneously with the speech stimuli. As a reference condition, we also used a visual search task that in earlier experiments had led to poorer speech perception. Both concurrent tasks led to decrements in the speech task. The results suggest that speech perception is affected even by loads thought to be processed modularly, and that, critically, encoding in working memory might be the locus of interference

Diagnostic performance and reference values of novel biomarkers of paediatric heart failure

Objective: Biomarkers play a pivotal role in heart failure (HF) management. Reference values and insights from studies in adults cannot be extrapolated to the paediatric population due to important differences in pathophysiology and compensatory reserve. We assessed the diagnostic utility of four novel biomarkers in paediatric HF. Methods: Midregional (MR) pro-atrial natriuretic peptide (proANP), soluble ST2 (sST2), growth differentiation factor-15 (GDF-15), MR-pro-adrenomedullin (proADM) and N-terminal pro-B natriuretic peptide (NT-proBNP) were measured in 114 patients and 89 controls. HF was defined as the presence of HF symptoms and/or abnormal systolic ventricular function. Receiver-operating characteristics were plotted, and the area under the curve (AUC) was measured. This was repeated for subgroups with cardiomyopathy and congenital heart disease (CHD). Ventricular systolic function was measured by magnetic resonance or echocardiography. Reference values were calculated according to the current guidelines. Results: The AUC for diagnosing HF was 0.76 for MR-proANP (CI 0.70 to 0.84) and 0.82 for NT-proBNP (CI 0.75 to 0.88). These parameters performed similarly in the subgroups with CHD and cardiomyopathy. By contrast, MR-proADM, GDF-15 and sST2 performed poorly. When used in conjunction with NT-proBNP, no parameter added significantly to its diagnostic accuracy. NT-proBNP, MR-proANP, GDF-15 and sST2 could accurately discriminate between patients with preserved and patients with poor functional status. In a subset of patients with dilated cardiomyopathy, NT-proBNP, MR-proANP, MR-proADM and GDF-15 were associated with poor LV function. Conclusions: MR-proANP could accurately detect HF in children and adolescents. Its diagnostic performance was comparable with that of NT-proBNP, regardless of the underlying condition. Reference values are presented

Immunoblot analysis of the seroreactivity to recombinant Borrelia burgdorferi sensu lato antigens, including VlsE, in the long-term course of treated patients with Erythema migrans

Objective: We evaluated whether immunoblotting is capable of substantiating the posttreatment clinical assessment of patients with erythema migrans ( EM), the hallmark of early Lyme borreliosis. Methods: In 50 patients, seroreactivity to different antigens of Borrelia burgdorferi sensu lato was analyzed by a recombinant immunoblot test (IB) in consecutive serum samples from a minimum follow-up period of 1 year. Antigens in the IgG test were decorin- binding protein A, internal fragment of p41 (p41i), outer surface protein C (OspC), p39, variable major protein-like sequence expressed (VlsE), p58 and p100; those in the IgM test were p41i, OspC and p39. Immune responses were correlated with clinical and treatment-related parameters. Results: Positive IB results were found in 50% before, in 57% directly after therapy and in 44% by the end of the follow-up for the IgG class, and in 36, 43 and 12% for the IgM class. In acute and convalescence phase sera, VlsE was most immunogenic on IgG testing 60 and 70%), and p41i (46 and 57%) and OspC (40 and 57%) for the IgM class. By the end of the follow-up, only the anti-p41i lgM response was significantly decreased to 24%. Conclusions: No correlation was found between IB results and treatment-related parameters. Thus, immunoblotting does not add to the clinical assessment of EM patients after treatment. Copyright (c) 2008 S. Karger AG, Basel

Do red deer stags (Cervus elaphus) use roar fundamental frequency (F0) to assess rivals?

It is well established that in humans, male voices are disproportionately lower pitched than female voices, and recent studies suggest that this dimorphism in fundamental frequency (F0) results from both intrasexual (male competition) and intersexual (female mate choice) selection for lower pitched voices in men. However, comparative investigations indicate that sexual dimorphism in F0 is not universal in terrestrial mammals. In the highly polygynous and sexually dimorphic Scottish red deer Cervus elaphus scoticus, more successful males give sexually-selected calls (roars) with higher minimum F0s, suggesting that high, rather than low F0s advertise quality in this subspecies. While playback experiments demonstrated that oestrous females prefer higher pitched roars, the potential role of roar F0 in male competition remains untested. Here we examined the response of rutting red deer stags to playbacks of re-synthesized male roars with different median F0s. Our results show that stags’ responses (latencies and durations of attention, vocal and approach responses) were not affected by the F0 of the roar. This suggests that intrasexual selection is unlikely to strongly influence the evolution of roar F0 in Scottish red deer stags, and illustrates how the F0 of terrestrial mammal vocal sexual signals may be subject to different selection pressures across species. Further investigations on species characterized by different F0 profiles are needed to provide a comparative background for evolutionary interpretations of sex differences in mammalian vocalizations

Scaling Laws in Human Language

Zipf's law on word frequency is observed in English, French, Spanish, Italian, and so on, yet it does not hold for Chinese, Japanese or Korean characters. A model for writing process is proposed to explain the above difference, which takes into account the effects of finite vocabulary size. Experiments, simulations and analytical solution agree well with each other. The results show that the frequency distribution follows a power law with exponent being equal to 1, at which the corresponding Zipf's exponent diverges. Actually, the distribution obeys exponential form in the Zipf's plot. Deviating from the Heaps' law, the number of distinct words grows with the text length in three stages: It grows linearly in the beginning, then turns to a logarithmical form, and eventually saturates. This work refines previous understanding about Zipf's law and Heaps' law in language systems.Comment: 6 pages, 4 figure

International meta-analysis of PTSD genome-wide association studies identifies sex- and ancestry-specific genetic risk loci.

The risk of posttraumatic stress disorder (PTSD) following trauma is heritable, but robust common variants have yet to be identified. In a multi-ethnic cohort including over 30,000 PTSD cases and 170,000 controls we conduct a genome-wide association study of PTSD. We demonstrate SNP-based heritability estimates of 5-20%, varying by sex. Three genome-wide significant loci are identified, 2 in European and 1 in African-ancestry analyses. Analyses stratified by sex implicate 3 additional loci in men. Along with other novel genes and non-coding RNAs, a Parkinson's disease gene involved in dopamine regulation, PARK2, is associated with PTSD. Finally, we demonstrate that polygenic risk for PTSD is significantly predictive of re-experiencing symptoms in the Million Veteran Program dataset, although specific loci did not replicate. These results demonstrate the role of genetic variation in the biology of risk for PTSD and highlight the necessity of conducting sex-stratified analyses and expanding GWAS beyond European ancestry populations

Analytic philosophy for biomedical research: the imperative of applying yesterday's timeless messages to today's impasses

The mantra that "the best way to predict the future is to invent it" (attributed to the computer scientist Alan Kay) exemplifies some of the expectations from the technical and innovative sides of biomedical research at present. However, for technical advancements to make real impacts both on patient health and genuine scientific understanding, quite a number of lingering challenges facing the entire spectrum from protein biology all the way to randomized controlled trials should start to be overcome. The proposal in this chapter is that philosophy is essential in this process. By reviewing select examples from the history of science and philosophy, disciplines which were indistinguishable until the mid-nineteenth century, I argue that progress toward the many impasses in biomedicine can be achieved by emphasizing theoretical work (in the true sense of the word 'theory') as a vital foundation for experimental biology. Furthermore, a philosophical biology program that could provide a framework for theoretical investigations is outlined