Scale-free memory model for multiagent reinforcement learning. Mean field approximation and rock-paper-scissors dynamics

A continuous time model for multiagent systems governed by reinforcement learning with scale-free memory is developed. The agents are assumed to act independently of one another in optimizing their choice of possible actions via trial-and-error search. To gain awareness about the action value the agents accumulate in their memory the rewards obtained from taking a specific action at each moment of time. The contribution of the rewards in the past to the agent current perception of action value is described by an integral operator with a power-law kernel. Finally a fractional differential equation governing the system dynamics is obtained. The agents are considered to interact with one another implicitly via the reward of one agent depending on the choice of the other agents. The pairwise interaction model is adopted to describe this effect. As a specific example of systems with non-transitive interactions, a two agent and three agent systems of the rock-paper-scissors type are analyzed in detail, including the stability analysis and numerical simulation. Scale-free memory is demonstrated to cause complex dynamics of the systems at hand. In particular, it is shown that there can be simultaneously two modes of the system instability undergoing subcritical and supercritical bifurcation, with the latter one exhibiting anomalous oscillations with the amplitude and period growing with time. Besides, the instability onset via this supercritical mode may be regarded as "altruism self-organization". For the three agent system the instability dynamics is found to be rather irregular and can be composed of alternate fragments of oscillations different in their properties.Comment: 17 pages, 7 figur

Delay in Antibiotic Administration Is Associated With Mortality Among Septic Shock Patients With Staphylococcus aureus Bacteremia

Objectives: The relationship between the timing of antibiotics and mortality among septic shock patients has not been examined among patients specifically with Staphylococcus aureus bacteremia. Design: Retrospective analysis of a Veterans Affairs S. aureus bacteremia database. Settings: One-hundred twenty-two hospitals in the Veterans Affairs Health System. Patients: Patients with septic shock and S. aureus bacteremia admitted directly from the emergency department to the ICU from January 1, 2003, to October 1, 2015, were evaluated. Interventions: Time to appropriate antibiotic administration and 30-day mortality. Measurements and Main Results: A total of 506 patients with S. aureus bacteremia and septic shock were included in the analysis. Thirty-day mortality was 78.1% for the entire cohort and was similar for those participants with methicillin-resistant S. aureus and methicillin-sensitive S. aureus bacteremia. Our multivariate analysis revealed that, as compared with those who received appropriate antibiotics within 1 hour after emergency department presentation, each additional hour that passed before appropriate antibiotics were administered produced an odds ratio of 1.11 (95% CI, 1.02–1.21) of mortality within 30 days. This odds increase equates to an average adjusted mortality increase of 1.3% (95% CI, 0.4–2.2%) for every hour that passes before antibiotics are administered. Conclusions: The results of this study further support the importance of prompt appropriate antibiotic administration for patients with septic shock. Physicians should consider acting quickly to administer antibiotics with S. aureus coverage to any patient suspected of having septic shock

Dietary fish oil supplements depress milk fat yield and alter milk fatty acid composition in lactating cows fed grass silage-based diets

201

Probiotic Bacteria Produce Conjugated Linoleic Acid Locally in the Gut That Targets Macrophage PPAR γ to Suppress Colitis

Inflammatory bowel disease (IBD) therapies are modestly successful and associated with significant side effects. Thus, the investigation of novel approaches to prevent colitis is important. Probiotic bacteria can produce immunoregulatory metabolites in vitro such as conjugated linoleic acid (CLA), a polyunsaturated fatty acid with potent anti-inflammatory effects. This study aimed to investigate the cellular and molecular mechanisms underlying the anti-inflammatory efficacy of probiotic bacteria using a mouse model of colitis. The immune modulatory mechanisms of VSL#3 probiotic bacteria and CLA were investigated in a mouse model of DSS colitis. Colonic specimens were collected for histopathology, gene expression and flow cytometry analyses. Immune cell subsets in the mesenteric lymph nodes (MLN), spleen, blood and colonic lamina propria cells were phenotypically and functionally characterized. Fecal samples and colonic contents were collected to determine the effect of VSL#3 and CLA on gut microbial diversity and CLA production. CLA and VSL#3 treatment ameliorated colitis and decreased colonic bacterial diversity, a finding that correlated with decreased gut pathology. Colonic CLA concentrations were increased in response to probiotic bacterial treatment, but without systemic distribution in blood. VSL#3 and CLA decreased macrophage accumulation in the MLN of mice with DSS colitis. The loss of PPAR γ in myeloid cells abrogated the protective effect of probiotic bacteria and CLA in mice with DSS colitis. Probiotic bacteria modulate gut microbial diversity and favor local production of CLA in the colon that targets myeloid cell PPAR γ to suppress colitis

The assessment of circulating volume using inferior vena cava collapse index and carotid Doppler velocity time integral in healthy volunteers: a pilot study

International audienceBackground: Assessment of circulating volume and the requirement for fluid replacement are fundamental to resuscitation but remain largely empirical. Passive leg raise (PLR) may determine fluid responders while avoiding potential fluid overload. We hypothesised that inferior vena cava collapse index (IVCCI) and carotid artery blood flow would change predictably in response to PLR, potentially providing a non-invasive tool to assess circulating volume and identifying fluid responsive patients.Methods: We conducted a prospective proof of concept pilot study on fasted healthy volunteers. One operator measured IVC diameter during quiet respiration and sniff, and carotid artery flow. Stroke volume (SV) was also measured using suprasternal Doppler. Our primary endpoint was change in IVCCI after PLR. We also studied changes in IVCCI after “sniff”, and correlation between carotid artery flow and SV.Results: Passive leg raise was associated with significant reduction in the mean inferior vena cava collapsibility index from 0.24 to 0.17 (p < 0.01). Mean stroke volume increased from 56.0 to 69.2 mL (p < 0.01). There was no significant change in common carotid artery blood flow. Changes in physiology consequent upon passive leg raise normalised rapidly.Discussion: Passive leg raise is associated with a decrease of IVCCI and increase in stroke volume. However, the wide range of values observed suggests that factors other than circulating volume predominate in determining the proportion of collapse with respiration.Conclusion: In contrast to other studies, we did not find that carotid blood flow increased with passive leg raise. Rapid normalisation of post-PLR physiology may account for this

MAP4K3 Is a Component of the TORC1 Signalling Complex that Modulates Cell Growth and Viability in Drosophila melanogaster

Background: MAP4K3 is a conserved Ser/Thr kinase that has being found in connection with several signalling pathways, including the Imd, EGFR, TORC1 and JNK modules, in different organisms and experimental assays. We have analyzed the consequences of changing the levels of MAP4K3 expression in the development of the Drosophila wing, a convenient model system to characterize gene function during epithelial development. Methodology and Principal Findings: Using loss-of-function mutants and over-expression conditions we find that MAP4K3 activity affects cell growth and viability in the Drosophila wing. These requirements are related to the modulation of the TORC1 and JNK signalling pathways, and are best detected when the larvae grow in a medium with low protein concentration (TORC1) or are exposed to irradiation (JNK). We also show that MAP4K3 display strong genetic interactions with different components of the InR/Tor signalling pathway, and can interact directly with the GTPases RagA and RagC and with the multi-domain kinase Tor. Conclusions and Significance: We suggest that MAP4K3 has two independent functions during wing development, one related to the activation of the JNK pathway in response to stress and other in the assembling or activation of the TORC1 complex, being critical to modulate cellular responses to changes in nutrient availability

Conversion of t11t13 CLA into c9t11 CLA in Caco-2 Cells and Inhibition by Sterculic Oil

Background : Conjugated linoleic acids (CLA), and principally c9t11 CLA, are suspected to have numerous preventive properties regarding non-infectious pathologies such as inflammatory diseases, atherosclerosis and several types of cancer. C9t11 CLA is produced in the rumen during biohydrogenation of linoleic acid, but can also be synthesized in mammalian tissues from trans-vaccenic acid (C18:1 t11) through the action of delta-9 desaturase (D9D). For several years, it is also known that c9t11 CLA can be synthesized from conjugated linolenic acids (CLnA), i.e. c9t11c13 CLnA and c9t11t13 CLnA. This study aimed at investigating to which extent and by which route c9t11 CLA can be produced from another isomer of CLA, the t11t13 CLA that is structurally very similar to c9t11t13 CLnA, in Caco-2 cells

l-Arginine stimulates proliferation and prevents endotoxin-induced death of intestinal cells

This study tested the hypothesis that l-arginine (Arg) may stimulate cell proliferation and prevent lipopolysaccharide (LPS)-induced death of intestinal cells. Intestinal porcine epithelial cells (IPEC-1) were cultured for 4 days in Arg-free Dulbecco’s modified Eagle’s-F12 Ham medium (DMEM-F12) containing 10, 100 or 350 μM Arg and 0 or 20 ng/ml LPS. Cell numbers, protein concentrations, protein synthesis and degradation, as well as mammalian target of rapamycin (mTOR) and Toll-like receptor 4 (TLR4) signaling pathways were determined. Without LPS, IPEC-1 cells exhibited time- and Arg-dependent growth curves. LPS treatment increased cell death and reduced protein concentrations in IPEC-1 cells. Addition of 100 and 350 μM Arg to culture medium dose-dependently attenuated LPS-induced cell death and reduction of protein concentrations, in comparison with the basal medium containing 10 μM Arg. Furthermore, supplementation of 100 and 350 μM Arg increased protein synthesis and reduced protein degradation in both control and LPS-treated IPEC-1 cells. Consistent with the data on cell growth and protein turnover, addition of 100 or 350 μM Arg to culture medium increased relative protein levels for phosphorylated mTOR and phosphorylated ribosomal protein S6 kinase-1, while reducing the relative levels of TLR4 and phosphorylated levels of nuclear factor-κB in LPS-treated IPEC-1 cells. These results demonstrate a protective effect of Arg against LPS-induced enterocyte damage through mechanisms involving mTOR and TLR4 signaling pathways, as well as intracellular protein turnover

Cis-regulatory evolution spotlights species differences in the adaptive potential of gene expression plasticity

Plasticity allows organisms to respond to environmental change. Here the authors compare the distribution of cis-regulatory variants in the transcriptomes of Arabidopsis lyrata and A. halleriafter exposure to stress, to trace the role of polygenic selection in the evolution of gene expression plasticity

Biogeographical Survey Identifies Consistent Alternative Physiological Optima and a Minor Role for Environmental Drivers in Maintaining a Polymorphism

The contribution of adaptive mechanisms in maintaining genetic polymorphisms is still debated in many systems. To understand the contribution of selective factors in maintaining polymorphism, we investigated large-scale (>1000 km) geographic variation in morph frequencies and fitness-related physiological traits in the damselfly Nehalennia irene. As fitness-related physiological traits, we investigated investment in immune function (phenoloxidase activity), energy storage and fecundity (abdomen protein and lipid content), and flight muscles (thorax protein content). In the first part of the study, our aim was to identify selective agents maintaining the large-scale spatial variation in morph frequencies. Morph frequencies varied considerably among populations, but, in contrast to expectation, in a geographically unstructured way. Furthermore, frequencies co-varied only weakly with the numerous investigated ecological parameters. This suggests that spatial frequency patterns are driven by stochastic processes, or alternatively, are consequence of highly variable and currently unidentified ecological conditions. In line with this, the investigated ecological parameters did not affect the fitness-related physiological traits differently in both morphs. In the second part of the study, we aimed at identifying trade-offs between fitness-related physiological traits that may contribute to the local maintenance of both colour morphs by defining alternative phenotypic optima, and test the spatial consistency of such trade-off patterns. The female morph with higher levels of phenoloxidase activity had a lower thorax protein content, and vice versa, suggesting a trade-off between investments in immune function and in flight muscles. This physiological trade-off was consistent across the geographical scale studied and supports widespread correlational selection, possibly driven by male harassment, favouring alternative trait combinations in both female morphs