Complex Unitary Recurrent Neural Networks using Scaled Cayley Transform

Recurrent neural networks (RNNs) have been successfully used on a wide range of sequential data problems. A well known difficulty in using RNNs is the \textit{vanishing or exploding gradient} problem. Recently, there have been several different RNN architectures that try to mitigate this issue by maintaining an orthogonal or unitary recurrent weight matrix. One such architecture is the scaled Cayley orthogonal recurrent neural network (scoRNN) which parameterizes the orthogonal recurrent weight matrix through a scaled Cayley transform. This parametrization contains a diagonal scaling matrix consisting of positive or negative one entries that can not be optimized by gradient descent. Thus the scaling matrix is fixed before training and a hyperparameter is introduced to tune the matrix for each particular task. In this paper, we develop a unitary RNN architecture based on a complex scaled Cayley transform. Unlike the real orthogonal case, the transformation uses a diagonal scaling matrix consisting of entries on the complex unit circle which can be optimized using gradient descent and no longer requires the tuning of a hyperparameter. We also provide an analysis of a potential issue of the modReLU activiation function which is used in our work and several other unitary RNNs. In the experiments conducted, the scaled Cayley unitary recurrent neural network (scuRNN) achieves comparable or better results than scoRNN and other unitary RNNs without fixing the scaling matrix

Monoclinic phase in the relaxor-based piezo-/ ferroelectric Pb(Mg1/3_{1/3}Nb2/3)O3_{2/3})O_3-PbTiO3_3 system

A ferroelectric monoclinic phase of space group $Cm$ ($M_A$ type) has been discovered in 0.65Pb(Mg$_{1/3}$Nb$_{2/3})O_3$-0.35PbTiO$_3$ by means of high resolution synchrotron X-ray diffraction. It appears at room temperature in a single crystal previously poled under an electric field of 43 kV/cm applied along the pseudocubic [001] direction, in the region of the phase diagram around the morphotropic phase boundary between the rhombohedral (R3m) and the tetragonal (P4mm) phases. The monoclinic phase has lattice parameters a = 5.692 A, b = 5.679 A, c = 4.050 A and $\beta$ = $90.15^{\circ}$, with the b$_m$-axis oriented along the pseudo-cubic [110] direction . It is similar to the monoclinic phase observed in PbZr$_{1-x}$Ti$_x$O$_3$, but different from that recently found in Pb(Zn$_{1/3}$Nb$_{2/3})O_3$-PbTiO$_3$, which is of space group $Pm$ ($M_C$ type).Comment: Revised version after referees' comments. PDF file. 6 pages, 4 figures embedde

Direct absorption imaging of ultracold polar molecules

We demonstrate a scheme for direct absorption imaging of an ultracold ground-state polar molecular gas near quantum degeneracy. A challenge in imaging molecules is the lack of closed optical cycling transitions. Our technique relies on photon shot-noise limited absorption imaging on a strong bound-bound molecular transition. We present a systematic characterization of this imaging technique. Using this technique combined with time-of-flight (TOF) expansion, we demonstrate the capability to determine momentum and spatial distributions for the molecular gas. We anticipate that this imaging technique will be a powerful tool for studying molecular quantum gases.Comment: 4 pages, 4 figure

Approximation algorithms for parallel machine scheduling with speed-up resources

We consider the problem of scheduling with renewable speed-up resources. Given m identical machines, n jobs and c different discrete resources, the task is to schedule each job non-preemptively onto one of the machines so as to minimize the makespan. In our problem, a job has its original processing time, which could be reduced by utilizing one of the resources. As resources are different, the amount of the time reduced for each job is different depending on the resource it uses. Once a resource is being used by one job, it can not be used simultaneously by any other job until this job is finished, hence the scheduler should take into account the job-to-machine assignment together with the resource-to-job assignment. We observe that, the classical unrelated machine scheduling problem is actually a special case of our problem when m=c, i.e., the number of resources equals the number of machines. Extending the techniques for the unrelated machine scheduling, we give a 2-approximation algorithm when both m and c are part of the input. We then consider two special cases for the problem, with m or c being a constant, and derive PTASes (Polynomial Time Approximation Schemes) respectively. We also establish the relationship between the two parameters m and c, through which we are able to transform the PTAS for the case when m is constant to the case when c is a constant. The relationship between the two parameters reveals the structure within the problem, and may be of independent interest

Modulational instability in a layered Kerr medium: Theory and Experiment

We present the first experimental investigation of modulational instability in a layered Kerr medium. The particularly interesting and appealing feature of our configuration, consisting of alternating glass-air layers, is the piecewise-constant nature of the material properties, which allows a theoretical linear stability analysis leading to a Kronig-Penney equation whose forbidden bands correspond to the modulationally unstable regimes. We find very good {\it quantitative} agreement between theoretical, numerical, and experimental diagnostics of the modulational instability. Because of the periodicity in the evolution variable arising from the layered medium, there are multiple instability regions rather than just one as in the uniform medium.Comment: 4 pages, 4 figures, contains experimental + computational + theoretical results, to appear in Physical Review Letter

Diffuse Neutron Scattering Study of Relaxor Ferroelectric (1-x)Pb(Zn1/3Nb2/3)O3-xPbTiO3(PZN-xPT)

Diffuse neutron scattering is a valuable tool to obtain information about the size and orientation of the polar nanoregions that are a characteristic feature of relaxor ferroelectrics. In this paper, we present new diffuse scattering results obtained on Pb(Zn1/3Nb2/3)O3 (PZN for short) and (1-x)Pb(Zn1/3Nb2/3)O3-xPbTiO3(PZN-xPT)single crystals (with x=4.5 and 9%), around various Bragg reflections and along three symmetry directions in the [100]-[011] zone. Diffuse scattering is observed around reflections with mixed indices, (100), (011) and (300), and along transverse and diagonal directions only. No diffuse scattering is found in longitudinal scans. The diffuse scattering peaks can be fitted well with a Lorentzian function, from which a correlation length is extracted. The correlation length increases with decreasing temperatures down to the transition at Tc, first following a Curie-Weiss law, then departing from it and becoming flat at very low temperatures. These results are interpreted in terms of three temperature regions: 1) dynamic polarization fluctuations (i.e. with a finite lifetime) at high temperatures, 2) static polarization reorientations (condensation of polar nanoregions) that can still reorient as a unit (relaxor behavior) at intermediate temperatures and 3) orientational freezing of the polar nanoregions with random strain fields in pure PZN or a structural phase transition in PZN-xPT at low temperatures. The addition of PT leads to a broadening of the diffuse scattering along the diagonal ([111]) relative to the transverse ([100]) direction, indicating a change in the orientation of the polar regions. Also, with the addition of PT, the polar nanoregions condense at a higher temperature above Tc.Comment: AIP 6x9 style files, 9 pages, 5 figures, Conference-Fundamental Physics of Ferroelectrics 200

Giant microwave photoresistance of two-dimensional electron gas

We measure microwave frequency (4-40 GHz) photoresistance at low magnetic field B, in high mobility 2D electron gas samples, excited by signals applied to a transmission line fabricated on the sample surface. Oscillatory photoresistance vs B is observed. For excitation at the cyclotron resonance frequency, we find an unprecedented, giant relative photoresistance (\Delta R)/R of up to 250 percent. The photoresistance is apparently proportional to the square root of applied power, and disappears as the temperature is increased.Comment: 4 pages, 3 figure