Reinforcement learning or active inference?

This paper questions the need for reinforcement learning or control theory when optimising behaviour. We show that it is fairly simple to teach an agent complicated and adaptive behaviours using a free-energy formulation of perception. In this formulation, agents adjust their internal states and sampling of the environment to minimize their free-energy. Such agents learn causal structure in the environment and sample it in an adaptive and self-supervised fashion. This results in behavioural policies that reproduce those optimised by reinforcement learning and dynamic programming. Critically, we do not need to invoke the notion of reward, value or utility. We illustrate these points by solving a benchmark problem in dynamic programming; namely the mountain-car problem, using active perception or inference under the free-energy principle. The ensuing proof-of-concept may be important because the free-energy formulation furnishes a unified account of both action and perception and may speak to a reappraisal of the role of dopamine in the brain

The use of biomedicine, complementary and alternative medicine, and ethno-medicine for the treatment of epilepsy among people of South Asian origin in the UK

Studies have shown that a significant proportion of people with epilepsy use complementary and alternative medicine (CAM). CAM use is known to vary between different ethnic groups and cultural contexts; however, little attention has been devoted to inter-ethnic differences within the UK population. We studied the use of biomedicine, complementary and alternative medicine, and ethnomedicine in a sample of people with epilepsy of South Asian origin living in the north of England

Superpulsed low-level laser therapy protects skeletal muscle of mdx mice against damage, inflammation and morphological changes delaying dystrophy progression.

Aim: To evaluate the effects of preventive treatment with low-level laser therapy (LLLT) on progression of dystrophy in mdx mice. Methods: Ten animals were randomly divided into 2 experimental groups treated with superpulsed LLLT (904 nm, 15 mW, 700 Hz, 1 J) or placebo-LLLT at one point overlying the tibialis anterior muscle (bilaterally) 5 times per week for 14 weeks (from 6th to 20th week of age). Morphological changes, creatine kinase (CK) activity and mRNA gene expression were assessed in animals at 20th week of age. Results: Animals treated with LLLT showed very few morphological changes in skeletal muscle, with less atrophy and fibrosis than animals treated with placebo-LLLT. CK was significantly lower (p = 0.0203) in animals treated with LLLT (864.70 U.l−1, SEM 226.10) than placebo (1708.00 U.l−1, SEM 184.60). mRNA gene expression of inflammatory markers was significantly decreased by treatment with LLLT (p<0.05): TNF-α (placebo-control = 0.51 µg/µl [SEM 0.12], - LLLT = 0.048 µg/µl [SEM 0.01]), IL-1β (placebo-control = 2.292 µg/µl [SEM 0.74], - LLLT = 0.12 µg/µl [SEM 0.03]), IL-6 (placebo-control = 3.946 µg/µl [SEM 0.98], - LLLT = 0.854 µg/µl [SEM 0.33]), IL-10 (placebo-control = 1.116 µg/µl [SEM 0.22], - LLLT = 0.352 µg/µl [SEM 0.15]), and COX-2 (placebo-control = 4.984 µg/µl [SEM 1.18], LLLT = 1.470 µg/µl [SEM 0.73]). Conclusion: Irradiation of superpulsed LLLT on successive days five times per week for 14 weeks decreased morphological changes, skeletal muscle damage and inflammation in mdx mice. This indicates that LLLT has potential to decrease progression of Duchenne muscular dystrophy

Coordinated optimization of visual cortical maps (II) Numerical studies

It is an attractive hypothesis that the spatial structure of visual cortical architecture can be explained by the coordinated optimization of multiple visual cortical maps representing orientation preference (OP), ocular dominance (OD), spatial frequency, or direction preference. In part (I) of this study we defined a class of analytically tractable coordinated optimization models and solved representative examples in which a spatially complex organization of the orientation preference map is induced by inter-map interactions. We found that attractor solutions near symmetry breaking threshold predict a highly ordered map layout and require a substantial OD bias for OP pinwheel stabilization. Here we examine in numerical simulations whether such models exhibit biologically more realistic spatially irregular solutions at a finite distance from threshold and when transients towards attractor states are considered. We also examine whether model behavior qualitatively changes when the spatial periodicities of the two maps are detuned and when considering more than 2 feature dimensions. Our numerical results support the view that neither minimal energy states nor intermediate transient states of our coordinated optimization models successfully explain the spatially irregular architecture of the visual cortex. We discuss several alternative scenarios and additional factors that may improve the agreement between model solutions and biological observations.Comment: 55 pages, 11 figures. arXiv admin note: substantial text overlap with arXiv:1102.335

Phenomenological Implications of Deflected Mirage Mediation: Comparison with Mirage Mediation

We compare the collider phenomenology of mirage mediation and deflected mirage mediation, which are two recently proposed "mixed" supersymmetry breaking scenarios motivated from string compactifications. The scenarios differ in that deflected mirage mediation includes contributions from gauge mediation in addition to the contributions from gravity mediation and anomaly mediation also present in mirage mediation. The threshold effects from gauge mediation can drastically alter the low energy spectrum from that of pure mirage mediation models, resulting in some cases in a squeezed gaugino spectrum and a gluino that is much lighter than other colored superpartners. We provide several benchmark deflected mirage mediation models and construct model lines as a function of the gauge mediation contributions, and discuss their discovery potential at the LHC.Comment: 29 pages, 9 figure

Observation of associated near-side and away-side long-range correlations in √sNN=5.02 TeV proton-lead collisions with the ATLAS detector

Two-particle correlations in relative azimuthal angle (Δϕ) and pseudorapidity (Δη) are measured in √sNN=5.02  TeV p+Pb collisions using the ATLAS detector at the LHC. The measurements are performed using approximately 1  μb-1 of data as a function of transverse momentum (pT) and the transverse energy (ΣETPb) summed over 3.1<η<4.9 in the direction of the Pb beam. The correlation function, constructed from charged particles, exhibits a long-range (2<|Δη|<5) “near-side” (Δϕ∼0) correlation that grows rapidly with increasing ΣETPb. A long-range “away-side” (Δϕ∼π) correlation, obtained by subtracting the expected contributions from recoiling dijets and other sources estimated using events with small ΣETPb, is found to match the near-side correlation in magnitude, shape (in Δη and Δϕ) and ΣETPb dependence. The resultant Δϕ correlation is approximately symmetric about π/2, and is consistent with a dominant cos⁡2Δϕ modulation for all ΣETPb ranges and particle pT

Search for direct pair production of the top squark in all-hadronic final states in proton-proton collisions at s√=8 TeV with the ATLAS detector

The results of a search for direct pair production of the scalar partner to the top quark using an integrated luminosity of 20.1fb−1 of proton–proton collision data at √s = 8 TeV recorded with the ATLAS detector at the LHC are reported. The top squark is assumed to decay via t˜→tχ˜01 or t˜→ bχ˜±1 →bW(∗)χ˜01 , where χ˜01 (χ˜±1 ) denotes the lightest neutralino (chargino) in supersymmetric models. The search targets a fully-hadronic final state in events with four or more jets and large missing transverse momentum. No significant excess over the Standard Model background prediction is observed, and exclusion limits are reported in terms of the top squark and neutralino masses and as a function of the branching fraction of t˜ → tχ˜01 . For a branching fraction of 100%, top squark masses in the range 270–645 GeV are excluded for χ˜01 masses below 30 GeV. For a branching fraction of 50% to either t˜ → tχ˜01 or t˜ → bχ˜±1 , and assuming the χ˜±1 mass to be twice the χ˜01 mass, top squark masses in the range 250–550 GeV are excluded for χ˜01 masses below 60 GeV

Neutrophils in cancer: neutral no more

Neutrophils are indispensable antagonists of microbial infection and facilitators of wound healing. In the cancer setting, a newfound appreciation for neutrophils has come into view. The traditionally held belief that neutrophils are inert bystanders is being challenged by the recent literature. Emerging evidence indicates that tumours manipulate neutrophils, sometimes early in their differentiation process, to create diverse phenotypic and functional polarization states able to alter tumour behaviour. In this Review, we discuss the involvement of neutrophils in cancer initiation and progression, and their potential as clinical biomarkers and therapeutic targets

A mutant O-GlcNAcase enriches Drosophila developmental regulators

YesProtein O-GlcNAcylation is a reversible post-translational modification of serines/threonines on nucleocytoplasmic proteins. It is cycled by the enzymes O-GlcNAc transferase (OGT) and O-GlcNAc hydrolase (O-GlcNAcase or OGA). Genetic approaches in model organisms have revealed that protein O-GlcNAcylation is essential for early embryogenesis. Drosophila melanogaster OGT/supersex combs (sxc) is a polycomb gene, null mutants of which display homeotic transformations and die at the pharate adult stage. However, the identities of the O-GlcNAcylated proteins involved, and the underlying mechanisms linking these phenotypes to embryonic development, are poorly understood. Identification of O-GlcNAcylated proteins from biological samples is hampered by the low stoichiometry of this modification and limited enrichment tools. Using a catalytically inactive bacterial O-GlcNAcase mutant as a substrate trap, we have enriched the O-GlcNAc proteome of the developing Drosophila embryo, identifying, amongst others, known regulators of Hox genes as candidate conveyors of OGT function during embryonic development.Wellcome Trust Investigator Award (110061); MRC grant (MC_UU_12016/5); and Royal Society Research Grant