Improving Search through A3C Reinforcement Learning based Conversational Agent

We develop a reinforcement learning based search assistant which can assist users through a set of actions and sequence of interactions to enable them realize their intent. Our approach caters to subjective search where the user is seeking digital assets such as images which is fundamentally different from the tasks which have objective and limited search modalities. Labeled conversational data is generally not available in such search tasks and training the agent through human interactions can be time consuming. We propose a stochastic virtual user which impersonates a real user and can be used to sample user behavior efficiently to train the agent which accelerates the bootstrapping of the agent. We develop A3C algorithm based context preserving architecture which enables the agent to provide contextual assistance to the user. We compare the A3C agent with Q-learning and evaluate its performance on average rewards and state values it obtains with the virtual user in validation episodes. Our experiments show that the agent learns to achieve higher rewards and better states.Comment: 17 pages, 7 figure

Spin- and energy relaxation of hot electrons at GaAs surfaces

The mechanisms for spin relaxation in semiconductors are reviewed, and the mechanism prevalent in p-doped semiconductors, namely spin relaxation due to the electron-hole exchange interaction, is presented in some depth. It is shown that the solution of Boltzmann-type kinetic equations allows one to obtain quantitative results for spin relaxation in semiconductors that go beyond the original Bir-Aronov-Pikus relaxation-rate approximation. Experimental results using surface sensitive two-photon photoemission techniques show that the spin relaxation-time of electrons in p-doped GaAs at a semiconductor/metal surface is several times longer than the corresponding bulk spin relaxation-times. A theoretical explanation of these results in terms of the reduced density of holes in the band-bending region at the surface is presented.Comment: 33 pages, 12 figures; earlier submission replaced by corrected and expanded version; eps figures now included in the tex

Large-scale 3-dimensional quantitative imaging of tissues: state-of-the-art and translational implications

Recent developments in automated optical sectioning microscope systems have enabled researchers to conduct high resolution, three-dimensional (3D) microscopy at the scale of millimeters in various types of tissues. This powerful technology allows the exploration of tissues at an unprecedented level of detail, while preserving the spatial context. By doing so, such technology will also enable researchers to explore cellular and molecular signatures within tissue and correlate with disease course. This will allow an improved understanding of pathophysiology and facilitate a precision medicine approach to assess the response to treatment. The ability to perform large-scale imaging in 3D cannot be realized without the widespread availability of accessible quantitative analysis. In this review, we will outline recent advances in large-scale 3D imaging and discuss the available methodologies to perform meaningful analysis and potential applications in translational research

Pion Structure Function in the Nambu and Jona-Lasinio model

The pion structure function is studied in the Nambu and Jona-Lasinio (NJL) model. We calculate the forward scattering amplitude of a virtual photon from a pion target in the Bjorken limit, and obtain valence quark distributions of the pion at the low energy hadronic scale, where the NJL model is supposed to work. The calculated distribution functions are evolved to the experimental momentum scale using the Altarelli-Parisi equation. The resulting distributions are in a reasonable agreement with experiment. We calculate also the kaon structure function and compare the ratio of kaon to pion valence u-quark distributions with experiment.Comment: 15 pages with 5 figures as uuencoded postscript files, TMU-NT-930301 (plain LaTeX

Meson Structure in Deep Inelastic Scattering

We study the deep inelastic structure functions of mesons within the Nambu and Jona-Lasinio model. We calculate the valence quark distributions in $\pi$, $K$, and $\rho$ mesons at the low energy model scale, which are evoluted to the experimental momentum scale in terms of the Altarelli-Parisi equation. The resulting distribution functions show reasonable agreements with experiment. We also discuss the semi-inclusive lepton nucleon scattering process with a slow nucleon in coincidence in the final state, which reveals the off-shell structure of the pion.Comment: 31 pages with 16 figures as uuencoded postscript files, TMU-NT-940101 (plain LaTeX

Single Gene Deletions of Orexin, Leptin, Neuropeptide Y, and Ghrelin Do Not Appreciably Alter Food Anticipatory Activity in Mice

Timing activity to match resource availability is a widely conserved ability in nature. Scheduled feeding of a limited amount of food induces increased activity prior to feeding time in animals as diverse as fish and rodents. Typically, food anticipatory activity (FAA) involves temporally restricting unlimited food access (RF) to several hours in the middle of the light cycle, which is a time of day when rodents are not normally active. We compared this model to calorie restriction (CR), giving the mice 60% of their normal daily calorie intake at the same time each day. Measurement of body temperature and home cage behaviors suggests that the RF and CR models are very similar but CR has the advantage of a clearly defined food intake and more stable mean body temperature. Using the CR model, we then attempted to verify the published result that orexin deletion diminishes food anticipatory activity (FAA) but observed little to no diminution in the response to CR and, surprisingly, that orexin KO mice are refractory to body weight loss on a CR diet. Next we tested the orexigenic neuropeptide Y (NPY) and ghrelin and the anorexigenic hormone, leptin, using mouse mutants. NPY deletion did not alter the behavior or physiological response to CR. Leptin deletion impaired FAA in terms of some activity measures, such as walking and rearing, but did not substantially diminish hanging behavior preceding feeding time, suggesting that leptin knockout mice do anticipate daily meal time but do not manifest the full spectrum of activities that typify FAA. Ghrelin knockout mice do not have impaired FAA on a CR diet. Collectively, these results suggest that the individual hormones and neuropepetides tested do not regulate FAA by acting individually but this does not rule out the possibility of their concerted action in mediating FAA

Formyl Peptide Receptor as a Novel Therapeutic Target for Anxiety-Related Disorders

Formyl peptide receptors (FPR) belong to a family of sensors of the immune system that detect microbe-associated molecules and inform various cellular and sensorial mechanisms to the presence of pathogens in the host. Here we demonstrate that Fpr2/3-deficient mice show a distinct profile of behaviour characterised by reduced anxiety in the marble burying and light-dark box paradigms, increased exploratory behaviour in an open-field, together with superior performance on a novel object recognition test. Pharmacological blockade with a formyl peptide receptor antagonist, Boc2, in wild type mice reproduced most of the behavioural changes observed in the Fpr2/3(-/-) mice, including a significant improvement in novel object discrimination and reduced anxiety in a light/dark shuttle test. These effects were associated with reduced FPR signalling in the gut as shown by the significant reduction in the levels of p-p38. Collectively, these findings suggest that homeostatic FPR signalling exerts a modulatory effect on anxiety-like behaviours. These findings thus suggest that therapies targeting FPRs may be a novel approach to ameliorate behavioural abnormalities present in neuropsychiatric disorders at the cognitive-emotional interface

Air-steam gasification of sewage sludge in a bubbling bed reactor: Effect of alumina as a primary catalyst

Numerous references can be found in scientific literature regarding biomass gasification. However, there are few works related to sludge gasification. A study of sewage sludge gasification process in a bubbling fluidised bed gasifier on a laboratory scale is here reported. The aim was to find the optimum conditions for reducing the production of tars and gain more information on the influx of different operating variables in the products resulting from the gasification of this waste. The variables studied were the equivalence ratio (ER), the steam-biomass ratio (SB) and temperature. Specifically, the ER was varied from 0.2 to 0.4, the SB from 0 to 1 and the temperature from 750 °C (1023 K) to 850 °C (1123 K). Although it was observed that tar production could be considerably reduced (up to 72%) by optimising the gasification conditions, the effect of using alumina (aluminium oxide, of proven efficacy in destroying the tar produced in biomass gasification) as primary catalyst in air and air-steam mixture tests was also verified. The results show that by adding small quantities of alumina to the bed (10% by weight of fed sludge) considerable reductions in tar production can be obtained (up to 42%) improving, at the same time, the lower heating value (LHV) of the gas and carbon conversion

Identification and characterization of a novel non-structural protein of bluetongue virus

Bluetongue virus (BTV) is the causative agent of a major disease of livestock (bluetongue). For over two decades, it has been widely accepted that the 10 segments of the dsRNA genome of BTV encode for 7 structural and 3 non-structural proteins. The non-structural proteins (NS1, NS2, NS3/NS3a) play different key roles during the viral replication cycle. In this study we show that BTV expresses a fourth non-structural protein (that we designated NS4) encoded by an open reading frame in segment 9 overlapping the open reading frame encoding VP6. NS4 is 77–79 amino acid residues in length and highly conserved among several BTV serotypes/strains. NS4 was expressed early post-infection and localized in the nucleoli of BTV infected cells. By reverse genetics, we showed that NS4 is dispensable for BTV replication in vitro, both in mammalian and insect cells, and does not affect viral virulence in murine models of bluetongue infection. Interestingly, NS4 conferred a replication advantage to BTV-8, but not to BTV-1, in cells in an interferon (IFN)-induced antiviral state. However, the BTV-1 NS4 conferred a replication advantage both to a BTV-8 reassortant containing the entire segment 9 of BTV-1 and to a BTV-8 mutant with the NS4 identical to the homologous BTV-1 protein. Collectively, this study suggests that NS4 plays an important role in virus-host interaction and is one of the mechanisms played, at least by BTV-8, to counteract the antiviral response of the host. In addition, the distinct nucleolar localization of NS4, being expressed by a virus that replicates exclusively in the cytoplasm, offers new avenues to investigate the multiple roles played by the nucleolus in the biology of the cell

The clinical features of the piriformis syndrome: a systematic review

Piriformis syndrome, sciatica caused by compression of the sciatic nerve by the piriformis muscle, has been described for over 70 years; yet, it remains controversial. The literature consists mainly of case series and narrative reviews. The objectives of the study were: first, to make the best use of existing evidence to estimate the frequencies of clinical features in patients reported to have PS; second, to identify future research questions. A systematic review was conducted of any study type that reported extractable data relevant to diagnosis. The search included all studies up to 1 March 2008 in four databases: AMED, CINAHL, Embase and Medline. Screening, data extraction and analysis were all performed independently by two reviewers. A total of 55 studies were included: 51 individual and 3 aggregated data studies, and 1 combined study. The most common features found were: buttock pain, external tenderness over the greater sciatic notch, aggravation of the pain through sitting and augmentation of the pain with manoeuvres that increase piriformis muscle tension. Future research could start with comparing the frequencies of these features in sciatica patients with and without disc herniation or spinal stenosis