Multisensory Congruency as a Mechanism for Attentional Control over Perceptual Selection

The neural mechanisms underlying attentional selection of competing neural signals for awareness remains an unresolved issue. We studied attentional selection, using perceptually ambiguous stimuli in a novel multisensory paradigm that combined competing auditory and competing visual stimuli. We demonstrate that the ability to select, and attentively hold, one of the competing alternatives in either sensory modality is greatly enhanced when there is a matching cross-modal stimulus. Intriguingly, this multimodal enhancement of attentional selection seems to require a conscious act of attention, as passively experiencing the multisensory stimuli did not enhance control over the stimulus. We also demonstrate that congruent auditory or tactile information, and combined auditory–tactile information, aids attentional control over competing visual stimuli and visa versa. Our data suggest a functional role for recently found neurons that combine voluntarily initiated attentional functions across sensory modalities. We argue that these units provide a mechanism for structuring multisensory inputs that are then used to selectively modulate early (unimodal) cortical processing, boosting the gain of task-relevant features for willful control over perceptual awareness

Direct evidence for encoding of motion streaks in human visual cortex

Temporal integration in the visual system causes fast-moving objects to generate static, oriented traces ('motion streaks'), which could be used to help judge direction of motion. While human psychophysics and single-unit studies in non-human primates are consistent with this hypothesis, direct neural evidence from the human cortex is still lacking. First, we provide psychophysical evidence that faster and slower motions are processed by distinct neural mechanisms: faster motion raised human perceptual thresholds for static orientations parallel to the direction of motion, whereas slower motion raised thresholds for orthogonal orientations. We then used functional magnetic resonance imaging to measure brain activity while human observers viewed either fast ('streaky') or slow random dot stimuli moving in different directions, or corresponding static-oriented stimuli. We found that local spatial patterns of brain activity in early retinotopic visual cortex reliably distinguished between static orientations. Critically, a multivariate pattern classifier trained on brain activity evoked by these static stimuli could then successfully distinguish the direction of fast ('streaky') but not slow motion. Thus, signals encoding static-oriented streak information are present in human early visual cortex when viewing fast motion. These experiments show that motion streaks are present in the human visual system for faster motion.This work was supported by the Wellcome Trust (G.R., D.S.S.), the European Union ‘Mindbridge’ project (B.B.), the Australian Federation of Graduate Women Tempe Mann Scholarship (D.A.), the University of Sydney Campbell Perry Travel Fellowship (D.A.) and the Brain Research Trust (C.K.)

Tilt aftereffects and tilt illusions induced by fast translational motion: evidence for motion streaks

Fast-moving visual features are thought to leave neural \u27streaks\u27 that can be detected by orientation-selective cells. Here, we tested whether \u27motion streaks\u27 can induce classic tilt aftereffects (TAEs) and tilt illusions (TIs). For TAEs, participants adapted to random arrays of small Gaussian blobs drifting at 9.5 deg/s. Following adaptation to directions of 15, 30, 45, 60, 75, and 90 degrees (clockwise from vertical) subjective vertical was measured for a briefly presented test grating. For TIs, the same motions were presented in an annular surround and subjective vertical was measured for a simultaneously presented central grating. All motions were 50% coherent, with half the blobs following random-walk paths and half following a fixed direction. Strong and weak streaks were compared by varying streak length (the number of fixed-walk frames), rather than by manipulating speed, so that speed and coherence were matched in all conditions. Strong motion streaks produced robust TAEs and TIs, similar in magnitude and orientation tuning to those induced by tilted lines. These effects were weak or absent in weak streak conditions, and when motion was too slow to form streaks. Together, these results indicate that motion streaks produced by temporal integration of fast translating features do effectively adapt orientation-selective cells and may therefore be exploited to improve perception of motion direction as described in the \u27motion streaks\u27 model

Attraction to the recent past in aesthetic judgments: A positive serial dependence for rating artwork

n/

Different coding strategies for the perception of stable and changeable facial attributes

Perceptual systems face competing requirements: improving signal-to-noise ratios of noisy images, by integration; and maximising sensitivity to change, by differentiation. Both processes occur in human vision, under different circumstances: they have been termed priming, or serial dependencies, leading to positive sequential effects; and adaptation or habituation, which leads to negative sequential effects. We reasoned that for stable attributes, such as the identity and gender of faces, the system should integrate: while for changeable attributes like facial expression, it should also engage contrast mechanisms to maximise sensitivity to change. Subjects viewed a sequence of images varying simultaneously in gender and expression, and scored each as male or female, and happy or sad. We found strong and consistent positive serial dependencies for gender, and negative dependency for expression, showing that both processes can operate at the same time, on the same stimuli, depending on the attribute being judged. The results point to highly sophisticated mechanisms for optimizing use of past information, either by integration or differentiation, depending on the permanence of that attribute

Attentional Modulation of Binocular Rivalry

Ever since Wheatstone initiated the scientific study of binocular rivalry, it has been debated whether the phenomenon is under attentional control. In recent years, the issue of attentional modulation of binocular rivalry has seen a revival. Here we review the classical studies as well as recent advances in the study of attentional modulation of binocular rivalry. We show that (1) voluntary control over binocular rivalry is possible, yet limited, (2) both endogenous and exogenous attention influence perceptual dominance during rivalry, (3) diverting attention from rival displays does not arrest perceptual alternations, and that (4) rival targets by themselves can also attract attention. From a theoretical perspective, we suggest that attention affects binocular rivalry by modulating the effective contrast of the images in competition. This contrast enhancing effect of top-down attention is counteracted by a response attenuating effect of neural adaptation at early levels of visual processing, which weakens the response to the dominant image. Moreover, we conclude that although frontal and parietal brain areas involved in both binocular rivalry and visual attention overlap, an adapting reciprocal inhibition arrangement at early visual cortex is sufficient to trigger switches in perceptual dominance independently of a higher-level “selection” mechanisms. Both of these processes are reciprocal and therefore self-balancing, with the consequence that complete attentional control over binocular rivalry can never be realized

A Collection of Pseudo-Words to Study Multi-Talker Speech Intelligibility without Shifts of Spatial Attention

A new collection of pseudo-words was recorded from a single female speaker of American English for use in multi-talker speech intelligibility research. The pseudo-words (known as the KARG collection) consist of three groups of single syllable pseudo-words varying only by the initial phoneme. The KARG method allows speech intelligibility to be studied free of the influence of shifts of spatial attention from one loudspeaker location to another in multi-talker contexts. To achieve this, all KARG pseudo-words share the same concluding rimes, with only the first phoneme serving as a distinguishing identifier. This ensures that listeners are unable to correctly identify the target pseudo-word without hearing the initial phoneme. As the duration of all the initial phonemes are brief, much shorter than the time required to spatially shift attention, the KARG method assesses speech intelligibility without the confound of shifting spatial attention. The KARG collection is available free for research purposes

Finding Flicker: Critical Differences in Temporal Frequency Capture Attention

Rapid visual flicker is known to capture attention. Here we show slow flicker can also capture attention under reciprocal temporal conditions. Observers searched for a target line (vertical or horizontal) among tilted distractors. Distractor lines were surrounded by luminance modulating annuli, all flickering sinusoidally at 1.3 or 12.1 Hz, while the target’s annulus flickered at frequencies within this range. Search times improved with increasing target/distractor frequency differences. For target–distractor frequency separations >5 Hz reaction times were minimal with high-frequency targets correctly identified more rapidly than low frequency targets (~400 ms). Critically, however, at these optimal frequency separations search times for low and high-frequency targets were unaffected by set size (slow flicker popped out from high flicker, and vice versa), indicating parallel and symmetric search performance when searching for high or low frequency targets. In a “cost” experiment using 1.3 and 12.1 Hz flicker, the unique flickering annulus sometimes surrounded a distractor and, on other trials, surrounded the target. When centered on a distractor, the unique frequency produced a clear and symmetrical search cost. Together, these symmetric pop-out and search costs demonstrate that temporal frequency is a pre-attentive visual feature capable of capturing attention, and that it is relative rather than absolute frequencies that are critical. The shape of the search functions strongly suggest that early visual temporal frequency filters underlie these effects