Upper-Confidence-Bound Algorithms for Active Learning in Multi-Armed Bandits

International audienceIn this paper, we study the problem of estimating the mean values of all the arms uniformly well in the multi-armed bandit setting. If the variances of the arms were known, one could design an optimal sampling strategy by pulling the arms proportionally to their variances. However, since the distributions are not known in advance, we need to design adaptive sampling strategies to select an arm at each round based on the previous observed samples. We describe two strategies based on pulling the arms proportionally to an upper-bound on their variances and derive regret bounds for these strategies. %on the excess estimation error compared to the optimal allocation. We show that the performance of these allocation strategies depends not only on the variances of the arms but also on the full shape of their distributions

Multiple Potts Models Coupled to Two-Dimensional Quantum Gravity

We perform Monte Carlo simulations using the Wolff cluster algorithm of {\it multiple} $q=2,3,4$ state Potts models on dynamical phi-cubed graphs of spherical topology in order to investigate the $c>1$ region of two-dimensional quantum gravity. Contrary to naive expectation we find no obvious signs of pathological behaviour for $c>1$. We discuss the results in the light of suggestions that have been made for a modified DDK ansatz for $c>1$.Comment: 9 page

Ground state at high density

Weak limits as the density tends to infinity of classical ground states of integrable pair potentials are shown to minimize the mean-field energy functional. By studying the latter we derive global properties of high-density ground state configurations in bounded domains and in infinite space. Our main result is a theorem stating that for interactions having a strictly positive Fourier transform the distribution of particles tends to be uniform as the density increases, while high-density ground states show some pattern if the Fourier transform is partially negative. The latter confirms the conclusion of earlier studies by Vlasov (1945), Kirzhnits and Nepomnyashchii (1971), and Likos et al. (2007). Other results include the proof that there is no Bravais lattice among high-density ground states of interactions whose Fourier transform has a negative part and the potential diverges or has a cusp at zero. We also show that in the ground state configurations of the penetrable sphere model particles are superposed on the sites of a close-packed lattice.Comment: Note adde

Quasiparticle contribution to heat carriers relaxation time in DyBa2_2Cu3_3O7−x_{7-x} from heat diffusivity measurements

It is shown that the controversy on phonons or electrons being the most influenced heat carriers below the critical temperature of high-T$_c$ superconductors can be resolved. Electrical and thermal properties of the same DyBa$_2$Cu$_3$O$_{7-x}$ monodomain have been measured for two highly different oxygenation levels. While the oxygenated sample DyBa$_2$Cu$_3$O$_{7}$ has very good superconducting properties ($T_c=90$ K), the DyBa$_2$Cu$_3$O$_{6.3}$ sample exhibits an insulator behavior. A careful comparison between measurements of the {\bf thermal diffusivity} of both samples allows us to extract the electronic contribution. This contribution to the relaxation time of heat carriers is shown to be large below $T_c$ and more sensitive to the superconducting state than the phonon contribution.Comment: 13 pages, 6 figure

A Model for the Development of the Rhizobial and Arbuscular Mycorrhizal Symbioses in Legumes and Its Use to Understand the Roles of Ethylene in the Establishment of these two Symbioses

We propose a model depicting the development of nodulation and arbuscular mycorrhizae. Both processes are dissected into many steps, using Pisum sativum L. nodulation mutants as a guideline. For nodulation, we distinguish two main developmental programs, one epidermal and one cortical. Whereas Nod factors alone affect the cortical program, bacteria are required to trigger the epidermal events. We propose that the two programs of the rhizobial symbiosis evolved separately and that, over time, they came to function together. The distinction between these two programs does not exist for arbuscular mycorrhizae development despite events occurring in both root tissues. Mutations that affect both symbioses are restricted to the epidermal program. We propose here sites of action and potential roles for ethylene during the formation of the two symbioses with a specific hypothesis for nodule organogenesis. Assuming the epidermis does not make ethylene, the microsymbionts probably first encounter a regulatory level of ethylene at the epidermis–outermost cortical cell layer interface. Depending on the hormone concentrations there, infection will either progress or be blocked. In the former case, ethylene affects the cortex cytoskeleton, allowing reorganization that facilitates infection; in the latter case, ethylene acts on several enzymes that interfere with infection thread growth, causing it to abort. Throughout this review, the difficulty of generalizing the roles of ethylene is emphasized and numerous examples are given to demonstrate the diversity that exists in plants

Measurement of the Charged Multiplicities in b, c and Light Quark Events from Z0 Decays

Average charged multiplicities have been measured separately in $b$, $c$ and light quark ($u,d,s$) events from $Z^0$ decays measured in the SLD experiment. Impact parameters of charged tracks were used to select enriched samples of $b$ and light quark events, and reconstructed charmed mesons were used to select $c$ quark events. We measured the charged multiplicities: $\bar{n}_{uds} = 20.21 \pm 0.10 (\rm{stat.})\pm 0.22(\rm{syst.})$, $\bar{n}_{c} = 21.28 \pm 0.46(\rm{stat.}) ^{+0.41}_{-0.36}(\rm{syst.})$ $\bar{n}_{b} = 23.14 \pm 0.10(\rm{stat.}) ^{+0.38}_{-0.37}(\rm{syst.})$, from which we derived the differences between the total average charged multiplicities of $c$ or $b$ quark events and light quark events: $\Delta \bar{n}_c = 1.07 \pm 0.47(\rm{stat.})^{+0.36}_{-0.30}(\rm{syst.})$ and $\Delta \bar{n}_b = 2.93 \pm 0.14(\rm{stat.})^{+0.30}_{-0.29}(\rm{syst.})$. We compared these measurements with those at lower center-of-mass energies and with perturbative QCD predictions. These combined results are in agreement with the QCD expectations and disfavor the hypothesis of flavor-independent fragmentation.Comment: 19 pages LaTex, 4 EPS figures, to appear in Physics Letters

Machine learning for emergent middleware

Highly dynamic and heterogeneous distributed systems are challenging today's middleware technologies. Existing middleware paradigms are unable to deliver on their most central promise, which is offering interoperability. In this paper, we argue for the need to dynamically synthesise distributed system infrastructures according to the current operating environment, thereby generating "Emergent Middleware'' to mediate interactions among heterogeneous networked systems that interact in an ad hoc way. The paper outlines the overall architecture of Enablers underlying Emergent Middleware, and in particular focuses on the key role of learning in supporting such a process, spanning statistical learning to infer the semantics of networked system functions and automata learning to extract the related behaviours of networked systems

Measurement of the CP-Violating Asymmetry Amplitude sin2β\beta

We present results on time-dependent CP-violating asymmetries in neutral B decays to several CP eigenstates. The measurements use a data sample of about 88 million Y(4S) --> B Bbar decays collected between 1999 and 2002 with the BABAR detector at the PEP-II asymmetric-energy B Factory at SLAC. We study events in which one neutral B meson is fully reconstructed in a final state containing a charmonium meson and the other B meson is determined to be either a B0 or B0bar from its decay products. The amplitude of the CP-violating asymmetry, which in the Standard Model is proportional to sin2beta, is derived from the decay-time distributions in such events. We measure sin2beta = 0.741 +/- 0.067 (stat) +/- 0.033 (syst) and |lambda| = 0.948 +/- 0.051 (stat) +/- 0.017 (syst). The magnitude of lambda is consistent with unity, in agreement with the Standard Model expectation of no direct CP violation in these modes

Age Dependency of the Prognostic Impact of Tumor Genomics in Localized Resectable MYCN-Nonamplified Neuroblastomas. Report From the SIOPEN Biology Group on the LNESG Trials and a COG Validation Group.

For localized, resectable neuroblastoma without MYCN amplification, surgery only is recommended even if incomplete. However, it is not known whether the genomic background of these tumors may influence outcome. Diagnostic samples were obtained from 317 tumors, International Neuroblastoma Staging System stages 1/2A/2B, from 3 cohorts: Localized Neuroblastoma European Study Group I/II and Children's Oncology Group. Genomic data were analyzed using multi- and pangenomic techniques and fluorescence in-situ hybridization in 2 age groups (cutoff age, 18 months) and were quality controlled by the International Society of Pediatric Oncology European Neuroblastoma (SIOPEN) Biology Group. Patients with stage 1 tumors had an excellent outcome (5-year event-free survival [EFS] ± standard deviation [SD], 95% ± 2%; 5-year overall survival [OS], 99% ± 1%). In contrast, patients with stage 2 tumors had a reduced EFS in both age groups (5-year EFS ± SD, 84% ± 3% in patients < 18 months of age and 75% ± 7% in patients ≥ 18 months of age). However, OS was significantly decreased only in the latter group (5-year OS ± SD in < 18months and ≥ 18months, 96% ± 2% and 81% ± 7%, respectively; P = .001). In < 18months, relapses occurred independent of segmental chromosome aberrations (SCAs); only 1p loss decreased EFS (5-year EFS ± SD in patients 1p loss and no 1p loss, 62% ± 13% and 87% ± 3%, respectively; P = .019) but not OS (5-year OS ± SD, 92% ± 8% and 97% ± 2%, respectively). In patients ≥ 18 months, only SCAs led to relapse and death, with 11q loss as the strongest marker (11q loss and no 11q loss: 5-year EFS ± SD, 48% ± 16% and 85% ± 7%, P = .033; 5-year OS ± SD, 46% ± 22% and 92% ± 6%, P = .038). Genomic aberrations of resectable non-MYCN-amplified stage 2 neuroblastomas have a distinct age-dependent prognostic impact. Chromosome 1p loss is a risk factor for relapse but not for diminished OS in patients < 18 months, SCAs (especially 11q loss) are risk factors for reduced EFS and OS in those > 18months. In older patients with SCA, a randomized trial of postoperative chemotherapy compared with observation alone may be indicated