Sound Adds Speed To Visual Perception

A new study shows that, in monkeys, the region involved in hearing can directly improve perception in the visual region, without the involvement of other structures to integrate the senses.

Integration of sensory stimuli has traditionally been thought of as hierarchical, involving brain areas that receive signals from distinct areas of the brain layer known as the cortex that recognise different stimuli. But the recent finding of nerve cells projecting from the auditory cortex (associated with the perception of sound) directly into the visual cortex (associated with sight), suggest that perception of one sense might affect that of another without the involvement of higher brain areas.

"Auditory or visual–auditory responses in the primary visual cortex are highly probable given the presence of direct projections from the primary auditory cortex", explain P. Barone and colleagues from the Centre for Brain and Cognition Research, Toulouse, France. "We looked for modulation of the neuronal visual responses in the primary visual cortex by auditory stimuli in an awake monkey."

The researchers recorded the neuronal responses with microelectrodes inserted directly into the primary visual cortex of a rhesus macaque. The monkey was then required to orient its gaze towards a visual stimulus. The time taken for the neurons in the visual cortex to respond to the stimulus, or latency, was recorded. Barone and colleagues then measured the latency when the visual stimulus was accompanied by a sound emanating from the same spot. When the visual signal was strong—i.e., high contrast—the auditory stimulus did not affect latency; however, if the visual signal was weaker—i.e., low contrast—latency decreased by 5-10%, suggesting that in some way the auditory stimulus speeds up the response to the visual stimulus.

"Our findings show that single neurons from one primary sensory cortex can integrate information from another sensory modality", the researchers claim. They propose that the auditory cue is processed more quickly than the visual stimulus, and because the monkeys have learned to associate that sound and sight, the visual cortex is primed to perceive the weaker signal. "Our results argue against a strict hierarchical model of sensory integration in the brain and that integration of multiple senses should be added to the list of functions of the primary visual cortex."