Bandit Problems with Side Observations

An extension of the traditional two-armed bandit problem is considered, in which the decision maker has access to some side information before deciding which arm to pull. At each time t, before making a selection, the decision maker is able to observe a random variable X_t that provides some information on the rewards to be obtained. The focus is on finding uniformly good rules (that minimize the growth rate of the inferior sampling time) and on quantifying how much the additional information helps. Various settings are considered and for each setting, lower bounds on the achievable inferior sampling time are developed and asymptotically optimal adaptive schemes achieving these lower bounds are constructed.Comment: 16 pages, 3 figures. To be published in the IEEE Transactions on Automatic Contro

Carbon dioxide and fruit odor transduction in Drosophila olfactory neurons. What controls their dynamic properties?

We measured frequency response functions between odorants and action potentials in two types of neurons in Drosophila antennal basiconic sensilla. CO2 was used to stimulate ab1C neurons, and the fruit odor ethyl butyrate was used to stimulate ab3A neurons. We also measured frequency response functions for light-induced action potential responses from transgenic flies expressing H134R-channelrhodopsin-2 (ChR2) in the ab1C and ab3A neurons. Frequency response functions for all stimulation methods were well-fitted by a band-pass filter function with two time constants that determined the lower and upper frequency limits of the response. Low frequency time constants were the same in each type of neuron, independent of stimulus method, but varied between neuron types. High frequency time constants were significantly slower with ethyl butyrate stimulation than light or CO2 stimulation. In spite of these quantitative differences, there were strong similarities in the form and frequency ranges of all responses. Since light-activated ChR2 depolarizes neurons directly, rather than through a chemoreceptor mechanism, these data suggest that low frequency dynamic properties of Drosophila olfactory sensilla are dominated by neuron-specific ionic processes during action potential production. In contrast, high frequency dynamics are limited by processes associated with earlier steps in odor transduction, and CO2 is detected more rapidly than fruit odor

Do Water Fountain Jets Really Indicate the Onset of the Morphological Metamorphosis of Circumstellar Envelopes?

The small-scale bipolar jets having short dynamical ages from "water fountain (WF)" sources are regarded as an indication of the onset of circumstellar envelope morphological metamorphosis of intermediate-mass stars. Such process usually happens at the end of the asymptotic giant branch (AGB) phase. However, recent studies found that WFs could be AGB stars or even early planetary nebulae. This fact prompted the idea that WFs may not necessarily be objects at the beginning of the morphological transition process. In the present work, we show that WFs could have different envelope morphologies by studying their spectral energy distribution profiles. Some WFs have spherical envelopes that resembles usual AGB stars, while others have aspherical envelopes which are more common to post-AGB stars. The results imply that WFs may not represent the earliest stage of the morphological metamorphosis. We further argue that the dynamical age of a WF jet, which can be calculated from maser proper motions, may not be the real age of the jet. The dynamical age cannot be used to justify the moment when the envelope begins to become aspherical, nor to tell the concrete evolutionary status of the object. A WF jet could be the innermost part of a larger well-developed jet, which is not necessarily a young jet.Comment: 21 pages, 4 figures, accepted for publication in MNRA

Design optimization of the JPL Phase B testbed

Increasingly complex spacecraft will benefit from integrated design and optimization of structural, optical, and control subsystems. Integrated design optimization will allow designers to make tradeoffs in objectives and constraints across these subsystems. The location, number, and types of passive and active devices distributed along the structure can have a dramatic impact on overall system performance. In addition, the manner in which structural mass is distributed can also serve as an effective mechanism for attenuating disturbance transmission between source and sensitive system components. This paper presents recent experience using optimization tools that have been developed for addressing some of these issues on a challenging testbed design problem. This particular testbed is one of a series of testbeds at the Jet Propulsion Laboratory under the sponsorship of the NASA Control Structure Interaction (CSI) Program to demonstrate nanometer level optical pathlength control on a flexible truss structure that emulates a spaceborne interferometer

Universal Quenching of Superconductivity in Two-dimensional Nano-islands

We systematically address superconductivity of Pb nano-islands with different thicknesses and lateral sizes via a scanning tunneling microscopy/spectroscopy. Reduction of the superconducting gap is observed even when the island is larger than the bulk coherence length and becomes very fast below ~ 50 nm lateral size. The suppression of gap with size depends to a good approximation only on the volume of the island and is independent of its shape. Theoretical analysis indicates that the universal quenching behavior is primarily manifested by the mean number of electronic orbitals within the pairing energy window.Comment: 19 pages, 8 figure