Video: Teaching the blind to read and recognize objects with sounds

Thursday, November 8, 2012

Brain Credit: Jens Lagner

Areas of the brain in blind people can learn to process visual input through the use of sound, even after years or perhaps even lifelong blindness, according to new research reported in the November issue of the Cell Press journal Neuron. The findings challenge the common belief that if the visual cortex of the brain is deprived of information in early life, it may never develop functional specialization.

"The adult brain is more flexible that we thought," says senior author Prof.. Amir Amedi, of the Edmond and Lily Safra Center for Brain Sciences and the Institute for Medical Research Israel-Canada at the Hebrew University Medical School.

In their studies, Prof. Amedi and his colleagues taught congenitally blind adults to use sensory substitution devices (SSDs), which are non-invasive sensory aids that provide visual information to the blind via their existing senses. For example, when a person uses a visual-to-auditory SSD, images from a video camera are converted into "soundscapes" that represent the images, allowing the user to listen to and then interpret the visual information coming from the camera (i.e. "seeing" with sounds).

This is an example of one image from each of the visual categories used in the structured SSD training (geometric shapes, Hebrew letters, textures, body postures, everyday objects, houses, and faces) is demonstrated, along with its corresponding transformation to sound via the vOICe SSD (two repetitions of each 2-s-long soundscape). Credit: Striem-Amit et al., Neuron

After being taught how to use the SSDs, blind people could use the devices to learn to read, with sounds representing visual images of letters. This skill involved a region of the brain called the Visual Word Form Area (VWFA), which in sighted people is activated by seeing and reading letters. After only tens of hours of training, blind people's VWFA also showed more activation for letters than for any of the other visual categories tested. The findings suggest that, at least in the blind, the tuning of VWFA to reading does not depend on vision. Instead, the VWFA may be selective to the type of information or computation rather than to the type of sensory input.

Blind people could also use SSDs to recognize soundscapes of visually complex categories such as faces, houses, and body parts. The results suggest that distinguishing meaningful shapes does not require vision, even though the brain activity that's needed to do so takes place in the part of the brain normally associated with vision in sighted individuals.

After the training program, participants could assign soundscapes to their visual categories and also determine multiple features of the stimulus (such as hairstyle in a face image, number of floors and windows in a house image, and body posture in a body-shape image), enabling them to differentiate between objects within categories. The movie depicts two examples of these abilities: a trained congenitally blind participant in the study as she reads a three-letter word and another participant as she identifies emotional facial expressions perceived through the SSD. Credit: Striem-Amit et al., Neuron

The findings also give hope that reintroduced input into the visual centers of the blind brain could potentially restore complex vision, and that SSDs might be useful for visual rehabilitation. "SSDs might help blind or visually-impaired individuals learn to process complex images, as done in this study, or they might be used as sensory interpreters that provide high-resolution supportive synchronous input to a visual signal arriving from an external device," says Professor Amedi.

###

Cell Press: http://www.cellpress.com

This press release was posted to serve as a topic for discussion. Please comment below. We try our best to only post press releases that are associated with peer reviewed scientific literature. Critical discussions of the research are appreciated. If you need help finding a link to the original article, please contact us on twitter or via e-mail.