Bayesian Nonparametric Inverse Reinforcement Learning

Inverse reinforcement learning (IRL) is the task of learning the reward function of a Markov Decision Process (MDP) given the transition function and a set of observed demonstrations in the form of state-action pairs. Current IRL algorithms attempt to find a single reward function which explains the entire observation set. In practice, this leads to a computationally-costly search over a large (typically infinite) space of complex reward functions. This paper proposes the notion that if the observations can be partitioned into smaller groups, a class of much simpler reward functions can be used to explain each group. The proposed method uses a Bayesian nonparametric mixture model to automatically partition the data and find a set of simple reward functions corresponding to each partition. The simple rewards are interpreted intuitively as subgoals, which can be used to predict actions or analyze which states are important to the demonstrator. Experimental results are given for simple examples showing comparable performance to other IRL algorithms in nominal situations. Moreover, the proposed method handles cyclic tasks (where the agent begins and ends in the same state) that would break existing algorithms without modification. Finally, the new algorithm has a fundamentally different structure than previous methods, making it more computationally efficient in a real-world learning scenario where the state space is large but the demonstration set is small

A Coulomb gas approach to the anisotropic one-dimensional Kondo lattice model at arbitrary filling

We establish a mapping of a general spin-fermion system in one dimension into a classical generalized Coulomb gas. This mapping allows a renormalization group treatment of the anisotropic Kondo chain both at and away from half-filling. We find that the phase diagram contains regions of paramagnetism, partial and full ferromagnetic order. We also use the method to analyze the phases of the Ising-Kondo chain.Comment: 19 pages, 9 figure

Search for antihelium in cosmic rays

The Alpha Magnetic Spectrometer (AMS) was flown on the space shuttle Discovery during flight STS-91 in a 51.7 degree orbit at altitudes between 320 and 390 km. A total of 2.86 * 10^6 helium nuclei were observed in the rigidity range 1 to 140 GV. No antihelium nuclei were detected at any rigidity. An upper limit on the flux ratio of antihelium to helium of < 1.1 * 10^-6 is obtained.Comment: 18 pages, Latex, 9 .eps figure

A Study of Cosmic Ray Secondaries Induced by the Mir Space Station Using AMS-01

The Alpha Magnetic Spectrometer (AMS-02) is a high energy particle physics experiment that will study cosmic rays in the $\sim 100 \mathrm{MeV}$ to $1 \mathrm{TeV}$ range and will be installed on the International Space Station (ISS) for at least 3 years. A first version of AMS-02, AMS-01, flew aboard the space shuttle \emph{Discovery} from June 2 to June 12, 1998, and collected $10^8$ cosmic ray triggers. Part of the \emph{Mir} space station was within the AMS-01 field of view during the four day \emph{Mir} docking phase of this flight. We have reconstructed an image of this part of the \emph{Mir} space station using secondary $\pi^-$ and $\mu^-$ emissions from primary cosmic rays interacting with \emph{Mir}. This is the first time this reconstruction was performed in AMS-01, and it is important for understanding potential backgrounds during the 3 year AMS-02 mission.Comment: To be submitted to NIM B Added material requested by referee. Minor stylistic and grammer change

Protons in near earth orbit

The proton spectrum in the kinetic energy range 0.1 to 200 GeV was measured by the Alpha Magnetic Spectrometer (AMS) during space shuttle flight STS-91 at an altitude of 380 km. Above the geomagnetic cutoff the observed spectrum is parameterized by a power law. Below the geomagnetic cutoff a substantial second spectrum was observed concentrated at equatorial latitudes with a flux ~ 70 m^-2 sec^-1 sr^-1. Most of these second spectrum protons follow a complicated trajectory and originate from a restricted geographic region.Comment: 19 pages, Latex, 7 .eps figure

Measurement of the photon+b+b-jet production differential cross section in ppˉp\bar{p} collisions at \sqrt{s}=1.96~\TeV

We present measurements of the differential cross section dsigma/dpT_gamma for the inclusive production of a photon in association with a b-quark jet for photons with rapidities |y_gamma|< 1.0 and 30<pT_gamma <300 GeV, as well as for photons with 1.5<|y_gamma|< 2.5 and 30< pT_gamma <200 GeV, where pT_gamma is the photon transverse momentum. The b-quark jets are required to have pT>15 GeV and rapidity |y_jet| < 1.5. The results are based on data corresponding to an integrated luminosity of 8.7 fb^-1, recorded with the D0 detector at the Fermilab Tevatron $p\bar{p}$ Collider at sqrt(s)=1.96 TeV. The measured cross sections are compared with next-to-leading order perturbative QCD calculations using different sets of parton distribution functions as well as to predictions based on the kT-factorization QCD approach, and those from the Sherpa and Pythia Monte Carlo event generators.Comment: 10 pages, 9 figures, submitted to Phys. Lett.

Measurement of spin correlation in ttbar production using dilepton final states

We measure the correlation between the spin of the top quark and the spin of the anti-top quark in (ttbar -> W+ W- b bbar -> l+ nu b l- nubar bbar) final states produced in ppbar collisions at a center of mass energy sqrt(s)=1.96 TeV, where l is an electron or muon. The data correspond to an integrated luminosity of 5.4 fb-1 and were collected with the D0 detector at the Fermilab Tevatron collider. The correlation is extracted from the angles of the two leptons in the t and tbar rest frames, yielding a correlation strength C= 0.10^{+0.45}_{-0.45}, in agreement with the NLO QCD prediction within two standard deviations, but also in agreement with the no correlation hypothesis.Comment: 10 pages, 3 figures, submitted to PL

Search for direct production of charginos and neutralinos in events with three leptons and missing transverse momentum in √s = 7 TeV pp collisions with the ATLAS detector

A search for the direct production of charginos and neutralinos in final states with three electrons or muons and missing transverse momentum is presented. The analysis is based on 4.7 fb−1 of proton–proton collision data delivered by the Large Hadron Collider and recorded with the ATLAS detector. Observations are consistent with Standard Model expectations in three signal regions that are either depleted or enriched in Z-boson decays. Upper limits at 95% confidence level are set in R-parity conserving phenomenological minimal supersymmetric models and in simplified models, significantly extending previous results

Search for pair production of the scalar top quark in muon+tau final states

We present a search for the pair production of scalar top quarks ($\tilde{t}_{1}$), the lightest supersymmetric partners of the top quarks, in $p\bar{p}$ collisions at a center-of-mass energy of 1.96 TeV, using data corresponding to an integrated luminosity of {7.3 $fb^{-1}$} collected with the \dzero experiment at the Fermilab Tevatron Collider. Each scalar top quark is assumed to decay into a $b$ quark, a charged lepton, and a scalar neutrino ($\tilde{\nu}$). We investigate final states arising from $\tilde{t}_{1} \bar{\tilde{t}_{1}} \rightarrow b\bar{b}\mu\tau \tilde{\nu} \tilde{\nu}$ and $\tilde{t}_{1} \bar{\tilde{t}_{1}} \rightarrow b\bar{b}\tau\tau \tilde{\nu} \tilde{\nu}$. With no significant excess of events observed above the background expected from the standard model, we set exclusion limits on this production process in the ($m_{\tilde{t}_{1}}$,$m_{\tilde{\nu}}$) plane.Comment: Submitted to Phys. Lett.

Measurement of D*+/- meson production in jets from pp collisions at sqrt(s) = 7 TeV with the ATLAS detector

This paper reports a measurement of D*+/- meson production in jets from proton-proton collisions at a center-of-mass energy of sqrt(s) = 7 TeV at the CERN Large Hadron Collider. The measurement is based on a data sample recorded with the ATLAS detector with an integrated luminosity of 0.30 pb^-1 for jets with transverse momentum between 25 and 70 GeV in the pseudorapidity range |eta| < 2.5. D*+/- mesons found in jets are fully reconstructed in the decay chain: D*+ -> D0pi+, D0 -> K-pi+, and its charge conjugate. The production rate is found to be N(D*+/-)/N(jet) = 0.025 +/- 0.001(stat.) +/- 0.004(syst.) for D*+/- mesons that carry a fraction z of the jet momentum in the range 0.3 < z < 1. Monte Carlo predictions fail to describe the data at small values of z, and this is most marked at low jet transverse momentum.Comment: 10 pages plus author list (22 pages total), 5 figures, 1 table, matches published version in Physical Review