Interpreting random forest classification models using a feature contribution method

Model interpretation is one of the key aspects of the model evaluation process. The explanation of the relationship between model variables and outputs is relatively easy for statistical models, such as linear regressions, thanks to the availability of model parameters and their statistical significance . For “black box” models, such as random forest, this information is hidden inside the model structure. This work presents an approach for computing feature contributions for random forest classification models. It allows for the determination of the influence of each variable on the model prediction for an individual instance. By analysing feature contributions for a training dataset, the most significant variables can be determined and their typical contribution towards predictions made for individual classes, i.e., class-specific feature contribution “patterns”, are discovered. These patterns represent a standard behaviour of the model and allow for an additional assessment of the model reliability for new data. Interpretation of feature contributions for two UCI benchmark datasets shows the potential of the proposed methodology. The robustness of results is demonstrated through an extensive analysis of feature contributions calculated for a large number of generated random forest models

A randomised clinical study to determine the effect of a toothpaste containing enzymes and proteins on plaque oral microbiome ecology

The numerous species that make up the oral microbiome are now understood to play a key role in establishment and maintenance of oral health. The ability to taxonomically identify community members at the species level is important to elucidating its diversity and association to health and disease. We report the overall ecological effects of using a toothpaste containing enzymes and proteins compared to a control toothpaste on the plaque microbiome. The results reported here demonstrate that a toothpaste containing enzymes and proteins can augment natural salivary defences to promote an overall community shift resulting in an increase in bacteria associated with gum health and a concomitant decrease in those associated with periodontal disease. Statistical analysis shows significant increases in 12 taxa associated with gum health including Neisseria spp. and a significant decrease in 10 taxa associated with periodontal disease including Treponema spp. The results demonstrate that a toothpaste containing enzymes and proteins can significantly shift the ecology of the oral microbiome (at species level) resulting in a community with a stronger association to health

Human cytomegalovirus immediate-early 1 protein rewires upstream STAT3 to downstream STAT1 signaling switching an IL6-type to an IFNγ-like response

MN and CP were supported by the Wellcome Trust (www.wellcome.ac.uk) Institutional Strategic Support Fund and CP was supported by the Deutsche Forschungsgemeinschaft (PA 815/2-1; www.dfg.de).The human cytomegalovirus (hCMV) major immediate-early 1 protein (IE1) is best known for activating transcription to facilitate viral replication. Here we present transcriptome data indicating that IE1 is as significant a repressor as it is an activator of host gene expression. Human cells induced to express IE1 exhibit global repression of IL6- and oncostatin M-responsive STAT3 target genes. This repression is followed by STAT1 phosphorylation and activation of STAT1 target genes normally induced by IFNγ. The observed repression and subsequent activation are both mediated through the same region (amino acids 410 to 445) in the C-terminal domain of IE1, and this region serves as a binding site for STAT3. Depletion of STAT3 phenocopies the STAT1-dependent IFNγ-like response to IE1. In contrast, depletion of the IL6 receptor (IL6ST) or the STAT kinase JAK1 prevents this response. Accordingly, treatment with IL6 leads to prolonged STAT1 instead of STAT3 activation in wild-type IE1 expressing cells, but not in cells expressing a mutant protein (IE1dl410-420) deficient for STAT3 binding. A very similar STAT1-directed response to IL6 is also present in cells infected with a wild-type or revertant hCMV, but not an IE1dl410-420 mutant virus, and this response results in restricted viral replication. We conclude that IE1 is sufficient and necessary to rewire upstream IL6-type to downstream IFNγ-like signaling, two pathways linked to opposing actions, resulting in repressed STAT3- and activated STAT1-responsive genes. These findings relate transcriptional repressor and activator functions of IE1 and suggest unexpected outcomes relevant to viral pathogenesis in response to cytokines or growth factors that signal through the IL6ST-JAK1-STAT3 axis in hCMV-infected cells. Our results also reveal that IE1, a protein considered to be a key activator of the hCMV productive cycle, has an unanticipated role in tempering viral replication.Publisher PDFPeer reviewe

Performance of random forest when SNPs are in linkage disequilibrium

<p>Abstract</p> <p>Background</p> <p>Single nucleotide polymorphisms (SNPs) may be correlated due to linkage disequilibrium (LD). Association studies look for both direct and indirect associations with disease loci. In a Random Forest (RF) analysis, correlation between a true risk SNP and SNPs in LD may lead to diminished variable importance for the true risk SNP. One approach to address this problem is to select SNPs in linkage equilibrium (LE) for analysis. Here, we explore alternative methods for dealing with SNPs in LD: change the tree-building algorithm by building each tree in an RF only with SNPs in LE, modify the importance measure (IM), and use haplotypes instead of SNPs to build a RF.</p> <p>Results</p> <p>We evaluated the performance of our alternative methods by simulation of a spectrum of complex genetics models. When a haplotype rather than an individual SNP is the risk factor, we find that the original Random Forest method performed on SNPs provides good performance. When individual, genotyped SNPs are the risk factors, we find that the stronger the genetic effect, the stronger the effect LD has on the performance of the original RF. A revised importance measure used with the original RF is relatively robust to LD among SNPs; this revised importance measure used with the revised RF is sometimes inflated. Overall, we find that the revised importance measure used with the original RF is the best choice when the genetic model and the number of SNPs in LD with risk SNPs are unknown. For the haplotype-based method, under a multiplicative heterogeneity model, we observed a decrease in the performance of RF with increasing LD among the SNPs in the haplotype.</p> <p>Conclusion</p> <p>Our results suggest that by strategically revising the Random Forest method tree-building or importance measure calculation, power can increase when LD exists between SNPs. We conclude that the revised Random Forest method performed on SNPs offers an advantage of not requiring genotype phase, making it a viable tool for use in the context of thousands of SNPs, such as candidate gene studies and follow-up of top candidates from genome wide association studies.</p

A New Way of Identifying Biomarkers in Biomedical Basic-Research Studies

A simple, nonparametric and distribution free method was developed for quick identification of the most meaningful biomarkers among a number of candidates in complex biological phenomena, especially in relatively small samples. This method is independent of rigid model forms or other link functions. It may be applied both to metric and non-metric data as well as to independent or matched parallel samples. With this method identification of the most relevant biomarkers is not based on inferential methods; therefore, its application does not require corrections of the level of significance, even in cases of thousands of variables. Hence, the introduced method is appropriate to analyze and evaluate data of complex investigations in clinical and pre-clinical basic research, such as gene or protein expressions, phenotype-genotype associations in case-control studies on the basis of thousands of genes and SNPs (single nucleotide polymorphism), search of prevalence in sleep EEG-Data, functional magnetic resonance imaging (fMRI) or others

Oral High-Dose Atorvastatin Treatment in Relapsing-Remitting Multiple Sclerosis

BACKGROUND:Recent data from animal models of multiple sclerosis (MS) and from a pilot study indicated a possible beneficial impact of statins on MS. METHODOLOGY/PRINCIPAL FINDINGS:Safety, tolerability and effects on disease activity of atorvastatin given alone or in combination with interferon-beta (IFN-beta) were assessed in a phase II open-label baseline-to-treatment trial in relapsing-remitting MS (RRMS). Patients with at least one gadolinium-enhancing lesion (CEL) at screening by magnetic resonance imaging (MRI) were eligible for the study. After a baseline period of 3 monthly MRI scans (months -2 to 0), patients followed a 9-month treatment period on 80 mg atorvastatin daily. The number of CEL in treatment months 6 to 9 compared to baseline served as the primary endpoint. Other MRI-based parameters as well as changes in clinical scores and immune responses served as secondary endpoints. Of 80 RRMS patients screened, 41 were included, among them 16 with IFN-beta comedication. The high dose of 80 mg atorvastatin was well tolerated in the majority of patients, regardless of IFN-beta comedication. Atorvastatin treatment led to a substantial reduction in the number and volume of CEL in two-sided multivariate analysis (p = 0.003 and p = 0.008). A trend towards a significant decrease in number and volume of CEL was also detected in patients with IFN-beta comedication (p = 0.060 and p = 0.062), in contrast to patients without IFN-beta comedication (p = 0.170 and p = 0.140). Immunological investigations showed no suppression in T cell response but a significant increase in IL-10 production. CONCLUSIONS/SIGNIFICANCE:Our data suggest that high-dose atorvastatin treatment in RRMS is safe and well tolerated. Moreover, MRI analysis indicates a possible beneficial effect of atorvastatin, alone or in combination with IFN-beta, on the development of new CEL. Thus, our findings provide a rationale for phase II/III trials, including combination of atorvastatin with already approved immunomodulatory therapy regimens. TRIAL REGISTRATION:ClinicalTrials.gov NCT00616187

TYK2 Kinase Activity Is Required for Functional Type I Interferon Responses In Vivo

Tyrosine kinase 2 (TYK2) is a member of the Janus kinase (JAK) family and is involved in cytokine signalling. In vitro analyses suggest that TYK2 also has kinase-independent, i.e., non-canonical, functions. We have generated gene-targeted mice harbouring a mutation in the ATP-binding pocket of the kinase domain. The Tyk2 kinase-inactive (Tyk2K923E) mice are viable and show no gross abnormalities. We show that kinase-active TYK2 is required for full-fledged type I interferon- (IFN) induced activation of the transcription factors STAT1-4 and for the in vivo antiviral defence against viruses primarily controlled through type I IFN actions. In addition, TYK2 kinase activity was found to be required for the protein’s stability. An inhibitory function was only observed upon over-expression of TYK2K923E in vitro. Tyk2K923E mice represent the first model for studying the kinase-independent function of a JAK in vivo and for assessing the consequences of side effects of JAK inhibitors

Activin A Induces Langerhans Cell Differentiation In Vitro and in Human Skin Explants

Langerhans cells (LC) represent a well characterized subset of dendritic cells located in the epidermis of skin and mucosae. In vivo, they originate from resident and blood-borne precursors in the presence of keratinocyte-derived TGFβ. Ιn vitro, LC can be generated from monocytes in the presence of GM-CSF, IL-4 and TGFβ. However, the signals that induce LC during an inflammatory reaction are not fully investigated. Here we report that Activin A, a TGFβ family member induced by pro-inflammatory cytokines and involved in skin morphogenesis and wound healing, induces the differentiation of human monocytes into LC in the absence of TGFβ. Activin A-induced LC are Langerin+, Birbeck granules+, E-cadherin+, CLA+ and CCR6+ and possess typical APC functions. In human skin explants, intradermal injection of Activin A increased the number of CD1a+ and Langerin+ cells in both the epidermis and dermis by promoting the differentiation of resident precursor cells. High levels of Activin A were present in the upper epidermal layers and in the dermis of Lichen Planus biopsies in association with a marked infiltration of CD1a+ and Langerin+ cells. This study reports that Activin A induces the differentiation of circulating CD14+ cells into LC. Since Activin A is abundantly produced during inflammatory conditions which are also characterized by increased numbers of LC, we propose that this cytokine represents a new pathway, alternative to TGFβ, responsible for LC differentiation during inflammatory/autoimmune conditions

Disruption of Growth Hormone Receptor Prevents Calorie Restriction from Improving Insulin Action and Longevity

Most mutations that delay aging and prolong lifespan in the mouse are related to somatotropic and/or insulin signaling. Calorie restriction (CR) is the only intervention that reliably increases mouse longevity. There is considerable phenotypic overlap between long-lived mutant mice and normal mice on chronic CR. Therefore, we investigated the interactive effects of CR and targeted disruption or knock out of the growth hormone receptor (GHRKO) in mice on longevity and the insulin signaling cascade. Every other day feeding corresponds to a mild (i.e. 15%) CR which increased median lifespan in normal mice but not in GHRKO mice corroborating our previous findings on the effects of moderate (30%) CR on the longevity of these animals. To determine why insulin sensitivity improves in normal but not GHRKO mice in response to 30% CR, we conducted insulin stimulation experiments after one year of CR. In normal mice, CR increased the insulin stimulated activation of the insulin signaling cascade (IR/IRS/PI3K/AKT) in liver and muscle. Livers of GHRKO mice responded to insulin by increased activation of the early steps of insulin signaling, which was dissipated by altered PI3K subunit abundance which putatively inhibited AKT activation. In the muscle of GHRKO mice, there was elevated downstream activation of the insulin signaling cascade (IRS/PI3K/AKT) in the absence of elevated IR activation. Further, we found a major reduction of inhibitory Ser phosphorylation of IRS-1 seen exclusively in GHRKO muscle which may underpin their elevated insulin sensitivity. Chronic CR failed to further modify the alterations in insulin signaling in GHRKO mice as compared to normal mice, likely explaining or contributing to the absence of CR effects on insulin sensitivity and longevity in these long-lived mice

The glycoprotein-hormones activin A and inhibin A interfere with dendritic cell maturation

<p>Abstract</p> <p>Background</p> <p>Pregnancy represents an exclusive situation in which the immune and the endocrine system cooperate to prevent rejection of the embryo by the maternal immune system. While immature dendritic cells (iDC) in the early pregnancy decidua presumably contribute to the establishment of peripheral tolerance, glycoprotein-hormones of the transforming growth factor beta (TGF-beta) family including activin A (ActA) and inhibin A (InA) are candidates that could direct the differentiation of DCs into a tolerance-inducing phenotype.</p> <p>Methods</p> <p>To test this hypothesis we generated iDCs from peripheral-blood-monocytes and exposed them to TGF-beta1, ActA, as well as InA and Dexamethasone (Dex) as controls.</p> <p>Results</p> <p>Both glycoprotein-hormones prevented up-regulation of HLA-DR during cytokine-induced DC maturation similar to Dex but did not influence the expression of CD 40, CD 83 and CD 86. Visualization of the F-actin cytoskeleton confirmed that the DCs retained a partially immature phenotype under these conditions. The T-cell stimulatory capacity of DCs was reduced after ActA and InA exposure while the secretion of cytokines and chemokines was unaffected.</p> <p>Conclusion</p> <p>These findings suggest that ActA and InA interfere with selected aspects of DC maturation and may thereby help preventing activation of allogenic T-cells by the embryo. Thus, we have identified two novel members of the TGF-beta superfamily that could promote the generation of tolerance-inducing DCs.</p