Learning Video Object Segmentation with Visual Memory

This paper addresses the task of segmenting moving objects in unconstrained videos. We introduce a novel two-stream neural network with an explicit memory module to achieve this. The two streams of the network encode spatial and temporal features in a video sequence respectively, while the memory module captures the evolution of objects over time. The module to build a "visual memory" in video, i.e., a joint representation of all the video frames, is realized with a convolutional recurrent unit learned from a small number of training video sequences. Given a video frame as input, our approach assigns each pixel an object or background label based on the learned spatio-temporal features as well as the "visual memory" specific to the video, acquired automatically without any manually-annotated frames. The visual memory is implemented with convolutional gated recurrent units, which allows to propagate spatial information over time. We evaluate our method extensively on two benchmarks, DAVIS and Freiburg-Berkeley motion segmentation datasets, and show state-of-the-art results. For example, our approach outperforms the top method on the DAVIS dataset by nearly 6%. We also provide an extensive ablative analysis to investigate the influence of each component in the proposed framework

Load-cell based characterization system for a "Violin-Mode" shadow-sensor in advanced LIGO suspensions

The background to this work was a prototype shadow sensor, which was designed for retro-fitting to an Advanced LIGO (Laser Interferometer Gravitational wave Observatory) test-mass/mirror suspension, in which 40 kg test-mass/mirrors are each suspended by four approximately 600 mm long by 0.4 mm diameter fused-silica suspension fibres. The shadow sensor comprised a LED source of Near InfraRed (NIR) radiation, and a rectangular silicon photodiode detector, which, together, were to bracket the fibre under test. The aim was to detect transverse Violin-Mode resonances in the suspension fibres. Part of the testing procedure involved tensioning a silica fibre sample, and translating it transversely through the illuminating NIR beam, so as to measure the DC responsivity of the detection system to fibre displacement. However, an equally important part of the procedure, reported here, was to keep the fibre under test stationary within the beam, whilst trying to detect low-level AC Violin-Mode resonances excited on the fibre, in order to confirm the primary function of the sensor. Therefore, a tensioning system, incorporating a load-cell readout, was built into the test fibre’s holder. The fibre then was excited by a signal generator, audio power amplifier, and distant loudspeaker, and clear resonances were detected. A theory for the expected fundamental resonant frequency as a function of fibre tension was developed, and is reported here, and this theory was found to match closely the detected resonant frequencies as they varied with tension. Consequently, the resonances seen were identified as being proper Violin-Mode fundamental resonances of the fibre, and the operation of the Violin-Mode detection system was validated

A step-wise steerable source of illumination for low-noise "Violin-Mode" shadow sensors, intended for use in interferometric gravitational wave detectors

A steerable low-noise source of illumination is described for shadow-sensors having a displacement sensitivity of ∼100 pm (rms)/√Hz, at 500 Hz, over a measuring span of at least ±0.5 mm. These sensors were designed to detect lateral "Violin-Mode" resonances in the highly tensioned fused-silica suspension fibres of the test-masses/mirrors for the Advanced Laser Interferometer Gravitational Wave Observatory gravitational wave detectors. The shadow sensors—one intended for each of the four fibres in a suspension—comprised a source of Near InfraRed (NIR) radiation (emitter) and a differential shadow-displacement sensor (detector), these bracketing the fibre under test. The suspension fibres themselves were approximately 600 mm long by 0.4 mm in diameter, and when illuminated from the side, they cast narrow, vertical, shadows onto their respective detectors—these being located at an effective distance of 50 fibre diameters behind the axes of the fibres themselves. The emitter described here was designed to compensate for a significant degree of mechanical drift or creep over time in the mean position of its suspension fibre. This was achieved by employing five adjacent columns of 8 × miniature NIR LEDs (Light Emitting Diodes, λ = 890 nm), with one column being activated at a time. When used in conjunction with a "reverse Galilean" telescope, the LED sources allowed the collimated beam from the emitter to be steered azimuthally in fine angular increments (0.65◦), causing the fibre's shadow to move laterally, in a step-wise manner, across the plane of its facing detector. Each step in shadow position was approximately 0.23 mm in size, and this allowed the fibre's shadow to be re-centred, so as to bridge once again both elements of its photodiode detector—even if the fibre was off-centred by as much as ±0.5 mm. Re-centring allowed Violin-Mode vibrations of the fibre to be sensed once again as differential AC photocurrents, these flowing in anti-phase in the two elements of the "split-photodiode" detector. C 2016 AIP Publishing LLC

The ISCIP Analyst, Volume XVI, Issue 6

This repository item contains a single issue of The ISCIP Analyst, an analytical review journal published from 1996 to 2010 by the Boston University Institute for the Study of Conflict, Ideology, and Policy