Deep Reinforcement Learning-based Image Captioning with Embedding Reward

Image captioning is a challenging problem owing to the complexity in understanding the image content and diverse ways of describing it in natural language. Recent advances in deep neural networks have substantially improved the performance of this task. Most state-of-the-art approaches follow an encoder-decoder framework, which generates captions using a sequential recurrent prediction model. However, in this paper, we introduce a novel decision-making framework for image captioning. We utilize a "policy network" and a "value network" to collaboratively generate captions. The policy network serves as a local guidance by providing the confidence of predicting the next word according to the current state. Additionally, the value network serves as a global and lookahead guidance by evaluating all possible extensions of the current state. In essence, it adjusts the goal of predicting the correct words towards the goal of generating captions similar to the ground truth captions. We train both networks using an actor-critic reinforcement learning model, with a novel reward defined by visual-semantic embedding. Extensive experiments and analyses on the Microsoft COCO dataset show that the proposed framework outperforms state-of-the-art approaches across different evaluation metrics

Source Imaging of a Moving Type-IV Solar Radio Burst and its Role in Tracking Coronal Mass Ejection From the Inner to the Outer Corona

Source imaging of solar radio bursts can be used to track energetic electrons and associated magnetic structures. Here we present a combined analysis of data at different wavelengths for an eruption associated with a moving type-IV (t-IVm) radio burst. In the inner corona, the sources are correlated with a hot and twisted eruptive EUV structure, while in the outer corona the sources are associated with the top front of the bright core of a white light coronal mass ejection (CME). This reveals the potential of using t-IVm imaging data to continuously track the CME by lighting up the specific component containing radio-emitting electrons. It is found that the t-IVm burst presents a clear spatial dispersion with observing frequencies. The burst manifests broken power-law like spectra in brightness temperature, which is as high as $10^7$-$10^9$ K while the polarization level is in-general weak. In addition, the t-IVm burst starts during the declining phase of the flare with a duration as long as 2.5 hours. From the differential emission measure analysis of AIA data, the density of the T-IVm source is likely at the level of 10$^8$ cm$^{-3}$ at the start of the burst, and the temperature may reach up to several MK. These observations do not favor gyro-synchrotron to be the radiation mechanism, yet in line with a coherent plasma emission excited by energetic electrons trapped within the source. Further studies are demanded to elucidate the emission mechanism and explore the full diagnostic potential of t-IVm bursts.Comment: 22 pages, 8 figures, Accepted for publication in AP

Use of low-dose computed tomography to assess pulmonary tuberculosis among healthcare workers in a tuberculosis hospital

BACKGROUND: According to the World Health Organization, China is one of 22 countries with serious tuberculosis (TB) infections and one of the 27 countries with serious multidrug-resistant TB strains. Despite the decline of tuberculosis in the overall population, healthcare workers (HCWs) are still at a high risk of infection. Compared with high-income countries, the TB prevalence among HCWs is higher in low- and middle-income countries. Low-dose computed tomography (LDCT) is becoming more popular due to its superior sensitivity and lower radiation dose. However, there have been no reports about active pulmonary tuberculosis (PTB) among HCWs as assessed with LDCT. The purposes of this study were to examine PTB statuses in HCWs in hospitals specializing in TB treatment and explore the significance of the application of LDCT to these workers. METHODS: This study retrospectively analysed the physical examination data of healthcare workers in the Beijing Chest Hospital from September 2012 to December 2015. Low-dose lung CT examinations were performed in all cases. The comparisons between active and inactive PTB according to the CT findings were made using the Pearson chi-square test or the Fisher’s exact test. Comparisons between the incidences of active PTB in high-risk areas and non-high-risk areas were performed using the Pearson chi-square test. Analyses of active PTB were performed according to different ages, numbers of years on the job, and the risks of the working areas. Active PTB as diagnosed by the LDCT examinations alone was compared with the final comprehensive diagnoses, and the sensitivity and positive predictive value were calculated. RESULTS: A total of 1 012 participants were included in this study. During the 4-year period of medical examinations, active PTB was found in 19 cases, and inactive PTB was found in 109 cases. The prevalence of active PTB in the participants was 1.24%, 0.67%, 0.81%, and 0.53% for years 2012 to 2015. The corresponding incidences of active PTB among the tuberculosis hospital participants were 0.86%, 0.41%, 0.54%, and 0.26%. Most HCWs with active TB (78.9%, 15/19) worked in the high-risk areas of the hospital. There was a significant difference in the incidences of active PTB between the HCWs who worked in the high-risk and non-high-risk areas (odds ratio [OR], 14.415; 95% confidence interval (CI): 4.733 – 43.896). Comparisons of the CT signs between the active and inactive groups via chi-square tests revealed that the tree-in-bud, cavity, fibrous shadow, and calcification signs exhibited significant differences (P = 0.000, 0.021, 0.001, and 0.024, respectively). Tree-in-bud and cavity opacities suggest active pulmonary tuberculosis, whereas fibrous shadow and calcification opacities are the main features of inactive pulmonary tuberculosis. Comparison with the final comprehensive diagnoses revealed that the sensitivity and positive predictive value of the diagnoses of active PTB based on LDCT alone were 100% and 86.4%, respectively. CONCLUSIONS: Healthcare workers in tuberculosis hospitals are a high-risk group for active PTB. Yearly LDCT examinations of such high-risk groups are feasible and necessary. ELECTRONIC SUPPLEMENTARY MATERIAL: The online version of this article (doi:10.1186/s40249-017-0274-6) contains supplementary material, which is available to authorized users

Oxytocin is implicated in social memory deficits induced by early sensory deprivation in mice

Acknowledgements We thank Miss Jia-Yin and Miss Yu-Ling Sun for their help in breading the mice. Funding This work was supported by grants from the National Natural Science Foundation of China (81200933 to N.-N. Song; 81200692 to L. Chen; 81101026 to Y. Huang; 31528011 to B. Lang; 81221001, 91232724 and 81571332 to Y-Q. Ding), Zhejiang Province Natural Science Foundation of China (LQ13C090004 to C. Zhang), China Postdoctoral Science Foundation (2016 M591714 to C.-C. Qi), and the Fundamental Research Funds for the Central Universities (2013KJ049).Peer reviewedPublisher PD

Experimental Test of Quantum Jarzynski Equality with a Trapped Ion System

The past two decades witnessed important developments in the field of non-equilibrium statistical mechanics. Among these developments, the Jarzynski equality, being a milestone following the landmark work of Clausius and Kelvin, stands out. The Jarzynski equality relates the free energy difference between two equilibrium states and the work done on the system through far from equilibrium processes. While experimental tests of the equality have been performed in classical regime, the verification of the quantum Jarzynski equality has not yet been fully demonstrated due to experimental challenges. Here, we report an experimental test of the quantum Jarzynski equality with a single \Yb ion trapped in a harmonic potential. We perform projective measurements to obtain phonon distributions of the initial thermal state. Following that we apply the laser induced force on the projected energy eigenstate, and find transition probabilities to final energy eigenstates after the work is done. By varying the speed of applying the force from equilibrium to far-from equilibrium regime, we verified the quantum Jarzynski equality in an isolated system.Comment: 18 pages, 4 figures, 1 tabl

Quantum simulation of the quantum Rabi model in a trapped ion

The quantum Rabi model, involving a two-level system and a bosonic field mode, is arguably the simplest and most fundamental model describing quantum light-matter interactions. Historically, due to the restricted parameter regimes of natural light-matter processes, the richness of this model has been elusive in the lab. Here, we experimentally realize a quantum simulation of the quantum Rabi model in a single trapped ion, where the coupling strength between the simulated light mode and atom can be tuned at will. The versatility of the demonstrated quantum simulator enables us to experimentally explore the quantum Rabi model in detail, including a wide range of otherwise unaccessible phenomena, as those happening in the ultrastrong and deep strong coupling regimes. In this sense, we are able to adiabatically generate the ground state of the quantum Rabi model in the deep strong coupling regime, where we are able to detect the nontrivial entanglement between the bosonic field mode and the two-level system. Moreover, we observe the breakdown of the rotating-wave approximation when the coupling strength is increased, and the generation of phonon wave packets that bounce back and forth when the coupling reaches the deep strong coupling regime. Finally, we also measure the energy spectrum of the quantum Rabi model in the ultrastrong coupling regime.Comment: 8 pages, 4 figure

Polydopamine-Coated Manganese Carbonate Nanoparticles for Amplified Magnetic Resonance Imaging-Guided Photothermal Therapy

【Abstract】This study reports a multifunctional nanoparticle (NP) with function of amplified magnetic resonance image (MRI)-guided photothermal therapy (PTT) by the surface coating of polydopamine (PDA) shell. Importantly, by means of introducing the surface coating of PDA，it helps entrap large quantities of water around NPs and allow more efficient water exchange， leading to greatly improved MR contrast signals compared with the one without PDA coating. Besides，the distinct photothermal effect can be obtained arising from the strong absorption of PDA in the near-infrared (NIR) region. By synthesizing the multifunctional MnCOs@PDA NPs as example，we found that the longitudinal relaxivity (ri) of MnCOs NPs might improve from 5.7 to 8.3 mM-is-i. Subsequently，In vitro MRI and PTT results verified that MnCOs@PDA could serve well as an excellent MRI/PTT theranostic agent. Furthermore， the MnCO3@PDA nanoparticles were applied as MRI/PTT theranostic agent for in vivo MRI-guided photothermal ablation of tumors by intratumorally injection in 4T1 tumor bearing-mice. The MR imaging result shows a significantly bright MR image in the tumor site. The MnCO3@PDA-mediated PTT result shows high therapy efficiency as a result of their high photothermal conversion efficiency. The present strategy of amplified MRI-guided PTT based on PDA coating on NPs will be widely applicable to other multifunctional nanoparticles.This study was financially supported by the National Natural Science Foundation of China (31271071，31371012，andU1505228)