Does learning an audiovisual association affect within-modal sensitivities?

Multisensory perception - Poster presentation: no. 66Previous findings showing that synesthetes with innate and acquired synesthesia have differing capacities in discriminating visual hues have led to the suggestion of a mental resource equilibrium model, which proposes that a shared resource pool exists across sensory modalities and that a reallocation of resources across the modalities could be triggered through establishment of cross-modal associations (Ward, 2009). In this study, we examined this proposition by testing whether training that promoted the formation of cross-modal associations (between visual brightness and auditory pitch) would affect subjects’ within-modal discrimination abilities for judging brightness and pitch. Participants were trained on either intuitive (i.e., positive correlation between the brightness of a uniform patch and pitch of a simultaneously presented sound stimulus), counterintuitive (i.e., negative correlation), or random brightness-pitch relationships, and tested before and after training on independent pitch and brightness discrimination tasks. We found that while training was successful in promoting the acquisition of the audiovisual correlations, it did not alter within-modal discrimination capacity for either brightness or pitch.Our data suggest that learned multimodal associations are not formed at a cost of altered within-modal sensitivities. We speculate that the strategies learned by subjects are likely more general in nature, and unlikely to be stimulus- or even modality-specific

Subcortical and cortical responses to local biological motion as revealed by fMRI and MEG

We report findings from both human fMRI (n = 35), and MEG (n = 10) experiments that tested neural responses to dynamic ('local', acceleration) cues in biological motion. We measured fMRI responses (3T Siemens Trio, 1.5 mm3) to point-light stimuli that were degraded according to: 1. spatial coherency (intact, horizontally scrambled with vertical order retained, horizontally scrambled with vertical order inverted); 2. local motion (intact, constant velocity); and 3. temporal structure (intact, scrambled). Results from MVPA decoding analyses revealed surprising sensitivity of subcortical (non-visual) thalamic area ventral lateral nucleus (VLN) for discriminating local naturally-accelerating biological motion from constant velocity motion, in addition to a wide cortical network that extends dorsally through the IPS and ventrally, including the STS. Retaining the vertical order of the local trajectories resulted in higher accuracies than inverting it, but phase-randomization did not affect (discrimination) responses. In a separate experiment, different subjects were presented with the same stimuli while magnetic responses were measured using a 360 channel whole head MEG system (Neuromag 360, Elekta; 1000 Hz sampling frequency). Results revealed responses in much of the same cortical network identified using fMRI, peaking at 100-150 ms, and again at 350-500 ms after stimulus onset during which we also observed important functional differences with greater activity in hMT+, LO, and STS for structure-from-motion versus the local natural acceleration stimulus, and greater early (V1-V3) and IPS activity for the local natural acceleration versus constant velocity motion. We also observed activity along the medial surface by 200 ms. The fact that medial activity arrives distinctly following early cortical activity (100-150 ms), but before the 350-500 ms window suggests that the implication of thalamic VLN for biological motion perception observed with fMRI may have arisen from early cortical responses, but not higher order extrastriate cortex