An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networks

Catastrophic forgetting is a problem faced by many machine learning models and algorithms. When trained on one task, then trained on a second task, many machine learning models "forget" how to perform the first task. This is widely believed to be a serious problem for neural networks. Here, we investigate the extent to which the catastrophic forgetting problem occurs for modern neural networks, comparing both established and recent gradient-based training algorithms and activation functions. We also examine the effect of the relationship between the first task and the second task on catastrophic forgetting. We find that it is always best to train using the dropout algorithm--the dropout algorithm is consistently best at adapting to the new task, remembering the old task, and has the best tradeoff curve between these two extremes. We find that different tasks and relationships between tasks result in very different rankings of activation function performance. This suggests the choice of activation function should always be cross-validated

Formal verification of kLIBC with the WP frama-C plug-in

This paper presents our results in the formal verification of kLIBC, a minimalistic C library, using the Frama-C/WP tool. We report how we were able to completely verify a significant number of functions from and . We discuss difficulties encountered and describe in detail a problem in the implementation of common functions, for which we suggest alternative implementations. Our work shows that it is presently already viable to verify low-level C code, with heavy usage of pointers. Although the properties proved tend to be shallower as the code becomes of a lower-level nature, it is our view that this is an important direction towards real-world software verification, which cannot be attained by focusing on deep properties of cleaner code, written specifically to be verified.This work is funded by ERDF - European Regional Development Fund through the COMPETE Programme (operational programme for competitiveness) and by National Funds through the FCT - Fundação para a Ciência e a Tecnologia (Portuguese Foundation for Science and Technology) within project FCOMP-01-0124-FEDER-020486

Observation of giant bandgap renormalization and excitonic effects in a monolayer transition metal dichalcogenide semiconductor

Two-dimensional (2D) transition metal dichalcogenides (TMDs) exhibit novel electrical and optical properties and are emerging as a new platform for exploring 2D semiconductor physics. Reduced screening in 2D results in dramatically enhanced electron-electron interactions, which have been predicted to generate giant bandgap renormalization and excitonic effects. Currently, however, there is little direct experimental confirmation of such many-body effects in these materials. Here we present an experimental observation of extraordinarily large exciton binding energy in a 2D semiconducting TMD. We accomplished this by determining the single-particle electronic bandgap of single-layer MoSe2 via scanning tunneling spectroscopy (STS), as well as the two-particle exciton transition energy via photoluminescence spectroscopy (PL). These quantities yield an exciton binding energy of 0.55 eV for monolayer MoSe2, a value that is orders of magnitude larger than what is seen in conventional 3D semiconductors. This finding is corroborated by our ab initio GW and Bethe Salpeter equation calculations, which include electron correlation effects. The renormalized bandgap and large exciton binding observed here will have a profound impact on electronic and optoelectronic device technologies based on single-layer semiconducting TMDs.Comment: Accepted for publication in Nature Material

A Gpr120-selective agonist improves insulin resistance and chronic inflammation in obese mice.

It is well known that the ω-3 fatty acids (ω-3-FAs; also known as n-3 fatty acids) can exert potent anti-inflammatory effects. Commonly consumed as fish products, dietary supplements and pharmaceuticals, ω-3-FAs have a number of health benefits ascribed to them, including reduced plasma triglyceride levels, amelioration of atherosclerosis and increased insulin sensitivity. We reported that Gpr120 is the functional receptor for these fatty acids and that ω-3-FAs produce robust anti-inflammatory, insulin-sensitizing effects, both in vivo and in vitro, in a Gpr120-dependent manner. Indeed, genetic variants that predispose to obesity and diabetes have been described in the gene encoding GPR120 in humans (FFAR4). However, the amount of fish oils that would have to be consumed to sustain chronic agonism of Gpr120 is too high to be practical, and, thus, a high-affinity small-molecule Gpr120 agonist would be of potential clinical benefit. Accordingly, Gpr120 is a widely studied drug discovery target within the pharmaceutical industry. Gpr40 is another lipid-sensing G protein-coupled receptor, and it has been difficult to identify compounds with a high degree of selectivity for Gpr120 over Gpr40 (ref. 11). Here we report that a selective high-affinity, orally available, small-molecule Gpr120 agonist (cpdA) exerts potent anti-inflammatory effects on macrophages in vitro and in obese mice in vivo. Gpr120 agonist treatment of high-fat diet-fed obese mice causes improved glucose tolerance, decreased hyperinsulinemia, increased insulin sensitivity and decreased hepatic steatosis. This suggests that Gpr120 agonists could become new insulin-sensitizing drugs for the treatment of type 2 diabetes and other human insulin-resistant states in the future

W boson production at hadron colliders: the lepton charge asymmetry in NNLO QCD

We consider the production of W bosons in hadron collisions, and the subsequent leptonic decay W->lnu_l. We study the asymmetry between the rapidity distributions of the charged leptons, and we present its computation up to the next-to-next-to-leading order (NNLO) in QCD perturbation theory. Our calculation includes the dependence on the lepton kinematical cuts that are necessarily applied to select W-> lnu_l events in actual experimental analyses at hadron colliders. We illustrate the main differences between the W and lepton charge asymmetry, and we discuss their physical origin and the effect of the QCD radiative corrections. We show detailed numerical results on the charge asymmetry in ppbar collisions at the Tevatron, and we discuss the comparison with some of the available data. Some illustrative results on the lepton charge asymmetry in pp collisions at LHC energies are presented.Comment: 37 pages, 21 figure

Impaired IFN-γ production and proliferation of NK cells in Multiple Sclerosis

NK cells are multicompetent lymphocytes of the innate immune system with a central role in host defense and immune regulation. Studies in experimental animal models of multiple sclerosis (MS) provided evidence for both pathologic and protective effects of NK cells. Humans harbor two functionally distinct NK-cell subsets exerting either predominantly cytotoxic (CD56dimCD16+) or immunoregulatory (CD56brightCD16−) functions. We analyzed these two subsets and their functions in the peripheral blood of untreated patients with relapsing-remitting MS compared with healthy blood donors. While ex vivo frequencies of CD56brightCD16− and CD56dimCD16+ NK cells were similar in patients and controls, we found that cytokine-driven in vitro accumulation and IFN-γ production of CD56brightCD16− NK cells but not of their CD56dimCD16+ counterparts were substantially diminished in MS. Impaired expansion of CD56brightCD16− NK cells was cell intrinsic because the observed effects could be reproduced with purified NK cells in an independent cohort of patients and controls. In contrast, cytolytic NK-cell activity toward the human erythromyeloblastoid leukemia cell line K562, the allogeneic CD4+ T cell line CEM and allogeneic primary CD4+ T-cell blasts was unchanged. Thus, characteristic functions of CD56brightCD16− NK cells, namely cytokine-induced NK cell expansion and IFN-γ production, are compromised in the NK cell compartment of MS patient

A systematic review on health resilience to economic crises

Background The health effects of recent economic crises differ markedly by population group. The objective of this systematic review is to examine evidence from longitudinal studies on factors influencing resilience for any health outcome or health behaviour among the general population living in countries exposed to financial crises. Methods We systematically reviewed studies from six electronic databases (EMBASE, Global Health, MEDLINE, PsycINFO, Scopus, Web of Science) which used quantitative longitudinal study designs and included: (i) exposure to an economic crisis; (ii) changes in health outcomes/behaviours over time; (iii) statistical tests of associations of health risk and/or protective factors with health outcomes/behaviours. The quality of the selected studies was appraised using the Quality Assessment Tool for Quantitative Studies. PRISMA reporting guidelines were followed. Results From 14,584 retrieved records, 22 studies met the eligibility criteria. These studies were conducted across 10 countries in Asia, Europe and North America over the past two decades. Ten socio-demographic factors that increased or protected against health risk were identified: gender, age, education, marital status, household size, employment/occupation, income/ financial constraints, personal beliefs, health status, area of residence, and social relations. These studies addressed physical health, mortality, suicide and suicide attempts, mental health, and health behaviours. Women’s mental health appeared more susceptible to crises than men’s. Lower income levels were associated with greater increases in cardiovascular disease, mortality and worse mental health. Employment status was associated with changes in mental health. Associations with age, marital status, and education were less consistent, although higher education was associated with healthier behaviours. Conclusions Despite widespread rhetoric about the importance of resilience, there was a dearth of studies which operationalised resilience factors. Future conceptual and empirical research is needed to develop the epidemiology of resilience

The photometric properties of a vast stellar substructure in the outskirts of M33

We have surveyed $\sim40$sq.degrees surrounding M33 with CFHT MegaCam in the g and i filters, as part of the Pan-Andromeda Archaeological Survey. Our observations are deep enough to resolve the top 4mags of the red giant branch population in this galaxy. We have previously shown that the disk of M33 is surrounded by a large, irregular, low-surface brightness substructure. Here, we quantify the stellar populations and structure of this feature using the PAndAS data. We show that the stellar populations of this feature are consistent with an old population with $\sim-1.6$dex and an interquartile range in metallicity of $\sim0.5$dex. We construct a surface brightness map of M33 that traces this feature to $\mu_V\simeq33$mags\,arcsec$^{-2}$. At these low surface brightness levels, the structure extends to projected radii of $\sim40$kpc from the center of M33 in both the north-west and south-east quadrants of the galaxy. Overall, the structure has an "S-shaped" appearance that broadly aligns with the orientation of the HI disk warp. We calculate a lower limit to the integrated luminosity of the structure of $-12.7\pm0.5$mags, comparable to a bright dwarf galaxy such as Fornax or AndII and slightly less than $1\$ of the total luminosity of M33. Further, we show that there is tentative evidence for a distortion in the distribution of young stars near the edge of the HI disk that occurs at similar azimuth to the warp in HI. The data also hint at a low-level, extended stellar component at larger radius that may be a M33 halo component. We revisit studies of M33 and its stellar populations in light of these new results, and we discuss possible formation scenarios for the vast stellar structure. Our favored model is that of the tidal disruption of M33 in its orbit around M31.Comment: Accepted for publication in ApJ. 17 figures. ApJ preprint forma

Occupational exposure to gases/fumes and mineral dust affect DNA methylation levels of genes regulating expression

Many workers are daily exposed to occupational agents like gases/fumes, mineral dust or biological dust, which could induce adverse health effects. Epigenetic mechanisms, such as DNA methylation, have been suggested to play a role. We therefore aimed to identify differentially methylated regions (DMRs) upon occupational exposures in never-smokers and investigated if these DMRs associated with gene expression levels. To determine the effects of occupational exposures independent of smoking, 903 never-smokers of the LifeLines cohort study were included. We performed three genome-wide methylation analyses (Illumina 450 K), one per occupational exposure being gases/fumes, mineral dust and biological dust, using robust linear regression adjusted for appropriate confounders. DMRs were identified using comb-p in Python. Results were validated in the Rotterdam Study (233 never-smokers) and methylation-expression associations were assessed using Biobank-based Integrative Omics Study data (n = 2802). Of the total 21 significant DMRs, 14 DMRs were associated with gases/fumes and 7 with mineral dust. Three of these DMRs were associated with both exposures (RPLP1 and LINC02169 (2x)) and 11 DMRs were located within transcript start sites of gene expression regulating genes. We replicated two DMRs with gases/fumes (VTRNA2-1 and GNAS) and one with mineral dust (CCDC144NL). In addition, nine gases/fumes DMRs and six mineral dust DMRs significantly associated with gene expression levels. Our data suggest that occupational exposures may induce differential methylation of gene expression regulating genes and thereby may induce adverse health effects. Given the millions of workers that are exposed daily to occupational exposures, further studies on this epigenetic mechanism and health outcomes are warranted