Reinforcement learning of normative monitoring intensities

Choosing actions within norm-regulated environments involves balancing achieving one’s goals and coping with any penalties for non-compliant behaviour. This choice becomes more complicated in environments where there is uncertainty. In this paper, we address the question of choosing actions in environments where there is uncertainty regarding both the outcomes of agent actions and the intensity of monitoring for norm violations. Our technique assumes no prior knowledge of probabilities over action outcomes or the likelihood of norm violations being detected by employing reinforcement learning to discover both the dynamics of the environment and the effectiveness of the enforcer. Results indicate agents become aware of greater rewards for violations when enforcement is lax, which gradually become less attractive as the enforcement is increased

Goal-oriented a posteriori error estimation for the travel time functional in porous media flows

In this article we consider the a posteriori error estimation and adaptive mesh refinement for the numerical approximation of the travel time functional arising in porous media flows. The key application of this work is in the safety assessment of radioactive waste facilities; in this setting, the travel time functional measures the time taken for a non-sorbing radioactive solute, transported by groundwater, to travel from a potential site deep underground to the biosphere. To ensure the computability of the travel time functional, we employ a mixed formulation of Darcy's law and conservation of mass, together with Raviart-Thomas H(div) conforming finite elements. The proposed a posteriori error bound is derived based on a variant of the standard Dual-Weighted-Residual approximation, which takes into account the lack of smoothness of the underlying functional of interest. The proposed adaptive refinement strategy is tested on both a simple academic test case and a problem based on the geological units found at the Sellafield site in the UK

A Dimension-Adaptive Multi-Index Monte Carlo Method Applied to a Model of a Heat Exchanger

We present an adaptive version of the Multi-Index Monte Carlo method, introduced by Haji-Ali, Nobile and Tempone (2016), for simulating PDEs with coefficients that are random fields. A classical technique for sampling from these random fields is the Karhunen-Lo\`eve expansion. Our adaptive algorithm is based on the adaptive algorithm used in sparse grid cubature as introduced by Gerstner and Griebel (2003), and automatically chooses the number of terms needed in this expansion, as well as the required spatial discretizations of the PDE model. We apply the method to a simplified model of a heat exchanger with random insulator material, where the stochastic characteristics are modeled as a lognormal random field, and we show consistent computational savings

The physical structure of the point-symmetric and quadrupolar planetary nebula NGC 6309

We analyse the point-symmetric planetary nebula NGC 6309 in terms of its three-dimensional structure and of internal variations of the physical conditions to deduce the physical processes involved in its formation. We used VLA-D 3.6-cm continuum, ground-based, and HST-archive imaging as well as long slit high- and low-dispersion spectroscopy. The low-dispersion spectra indicate a high excitation nebula, with low to medium variations of its internal physical conditions. In the optical images, the point-symmetric knots show a lack of [NII] emission as compared with similar features previously known in other PNe. A rich internal structure of the central region is seen in the HST images, resembling a deformed torus. Long slit high-dispersion spectra reveal a complex kinematics in the central region. The spectral line profiles from the external regions of NGC 6309 indicate expanding lobes (~40 km/s) as those generally found in bipolar nebulae. Finally, we have found evidence for the presence of a faint halo, possibly related to the envelope of the AGB-star progenitor. Our data indicate that NGC 6309 is a quadrupolar nebula with two pairs of bipolar lobes whose axes are oriented PA=40 and PA=76. Equatorial and polar velocities for these two pairs of lobes are 29 and 86 km/s for the bipolar system at PA=40 and 25 and 75 km/s for the bipolar system at PA=76. There is also a central torus that is expanding at 25 km/s. Kinematical age for all these structures is around 3700 to 4000 yr. We conclude that NGC 6309 was formed by a set of well-collimated bipolar outflows (jets), which were ejected in the initial stages of its formation as a planetary nebula. These jets carved the bipolar lobes in the previous AGB wind and their remnants are now observed as the point-symmetric knots tracing the edges of the lobes.Comment: To be published in Astronomy & Astrophysics; 11 pages, 8 figures, 4 table

Numerical and Experimental Investigation of Circulation in Short Cylinders

In preparation for an experimental study of magnetorotational instability (MRI) in liquid metal, we explore Couette flows having height comparable to the gap between cylinders, centrifugally stable rotation, and high Reynolds number. Experiments in water are compared with numerical simulations. Simulations show that endcaps corotating with the outer cylinder drive a strong poloidal circulation that redistributes angular momentum. Predicted azimuthal flow profiles agree well with experimental measurements. Spin-down times scale with Reynolds number as expected for laminar Ekman circulation; extrapolation from two-dimensional simulations at $Re\le 3200$ agrees remarkably well with experiment at $Re\sim 10^6$. This suggests that turbulence does not dominate the effective viscosity. Further detailed numerical studies reveal a strong radially inward flow near both endcaps. After turning vertically along the inner cylinder, these flows converge at the midplane and depart the boundary in a radial jet. To minimize this circulation in the MRI experiment, endcaps consisting of multiple, differentially rotating rings are proposed. Simulations predict that an adequate approximation to the ideal Couette profile can be obtained with a few rings

Variation in the helminth community structure in spiny mice (Acomys dimidiatus) from four montane wadis in the St Katherine region of the Sinai Peninsula in Egypt

We compared helminth communities in spiny mice (Acomys dimidiatus) from 4 wadis in the arid montane region of the southern Sinai in Egypt, in a 4-week period in late summer. Total helminth species richness was 14 (8 nematodes, 5 cestodes and 1 acanthocephalan) with 94% of mice carrying at least 1 species and an overall mean species richness of 1.85. The most prevalent parasites were Protospirura muricola (47.8%) and Dentostomella kuntzi (46.3%). One larval cestode, Joyeuxiella rossicum, represents a new host record. The helminth community was dominated by intestinal nematodes (88.7%) of which 58.2% were arthropod-transmitted heteroxenic species. At the component community level, 70% of the worms were recovered from mice in just two wadis (Gharaba and Tlah) and 48.6% of intestinal nematodes were from Wadi Gharaba. Although only 7 species of helminths were recorded from Wadi Gharaba, this site gave the highest Berger-Parker dominance index because P. muricola. P. muricola was also dominant in Wadi El Arbaein whilst Syphacia minuta was the dominant species in Wadis Gebal and Tlah. At the infracommunity level, mean species richness and Brillouin’s index of diversity were highest in Wadi Tlah and lowest in Wadi Gebal, and the former was age dependent. Whilst mice from different wadis differed in the nematodes that were most common, those from Wadi Gharaba carried the highest mean number of worms/mouse. The abundance of P. muricola in particular varied markedly between sites: Wadi Gharaba was distinct as the site showing the highest mean worm burden whereas mice from Wadi Gebal were uninfected. None of the directly transmitted oxyuroid nematodes showed significant variation in abundance between wadis, or host sex or age classes. Overall, the single extrinsic factor in the study, site of capture, was more important than the intrinsic factors in explaining variation in helminth communities in the region. We conclude that in the high mountains of southern Sinai, each wadi is distinct in terms of its rodent parasites, and hence we expect spatially different coevolutionary pressures on their hosts, with resultant variation in life-histories

Mass Transfer by Stellar Wind

I review the process of mass transfer in a binary system through a stellar wind, with an emphasis on systems containing a red giant. I show how wind accretion in a binary system is different from the usually assumed Bondi-Hoyle approximation, first as far as the flow's structure is concerned, but most importantly, also for the mass accretion and specific angular momentum loss. This has important implications on the evolution of the orbital parameters. I also discuss the impact of wind accretion, on the chemical pollution and change in spin of the accreting star. The last section deals with observations and covers systems that most likely went through wind mass transfer: barium and related stars, symbiotic stars and central stars of planetary nebulae (CSPN). The most recent observations of cool CSPN progenitors of barium stars, as well as of carbon-rich post-common envelope systems, are providing unique constraints on the mass transfer processes.Comment: Chapter 7, in Ecology of Blue Straggler Stars, H.M.J. Boffin, G. Carraro & G. Beccari (Eds), Astrophysics and Space Science Library, Springe