Improving Variational Encoder-Decoders in Dialogue Generation

Variational encoder-decoders (VEDs) have shown promising results in dialogue generation. However, the latent variable distributions are usually approximated by a much simpler model than the powerful RNN structure used for encoding and decoding, yielding the KL-vanishing problem and inconsistent training objective. In this paper, we separate the training step into two phases: The first phase learns to autoencode discrete texts into continuous embeddings, from which the second phase learns to generalize latent representations by reconstructing the encoded embedding. In this case, latent variables are sampled by transforming Gaussian noise through multi-layer perceptrons and are trained with a separate VED model, which has the potential of realizing a much more flexible distribution. We compare our model with current popular models and the experiment demonstrates substantial improvement in both metric-based and human evaluations.Comment: Accepted by AAAI201

Scattering universality classes of side jump in anomalous Hall effect

The anomalous Hall conductivity has an important extrinsic contribution known as side jump contribution, which is independent of both scattering strength and disorder density. Nevertheless, we discover that side jump has strong dependence on the spin structure of the scattering potential. We propose three universality classes of scattering for the side jump contribution, having the characters of being spin-independent, spin-conserving and spin-flip respectively. For each individual class, the side jump contribution takes a different unique value. When two or more classes of scattering are present, the value of side jump is no longer fixed but varies as a function of their relative disorder strength. As system control parameter such as temperature changes, due to the competition between different classes of disorder scattering, the side jump Hall conductivity could flow from one class dominated limit to another class dominated limit. Our result indicates that magnon scattering plays a role distinct from normal impurity scattering and phonon scattering in the anomalous Hall effect because they belong to different scattering classes

Traveling waves in lattice differential equations with distributed maturation delay

In this paper we derive a lattice model with infinite distributed delay to describe the growth of a single-species population in a 2D patchy environment with infinite number of patches connected locally by diffusion and global interaction. We consider the existence of traveling wave solutions when the birth rate is large enough that each patch can sustain a positive equilibrium. When the birth function is monotone, we prove that there exists a traveling wave solution connecting two equilibria with wave speed $c>c^*(\theta)$ by using the monotone iterative method and super and subsolution technique, where $\theta\in [0,2\pi]$ is any fixed direction of propagation. When the birth function is non-monotone, we prove the existence of non-trivial traveling wave solutions by constructing two auxiliary systems satisfying quasi-monotonicity

A Conditional Variational Framework for Dialog Generation

Deep latent variable models have been shown to facilitate the response generation for open-domain dialog systems. However, these latent variables are highly randomized, leading to uncontrollable generated responses. In this paper, we propose a framework allowing conditional response generation based on specific attributes. These attributes can be either manually assigned or automatically detected. Moreover, the dialog states for both speakers are modeled separately in order to reflect personal features. We validate this framework on two different scenarios, where the attribute refers to genericness and sentiment states respectively. The experiment result testified the potential of our model, where meaningful responses can be generated in accordance with the specified attributes.Comment: Accepted by ACL201