'Brain-reading' Methods Developed

That has changed with the findings of scientists at Rutgers University in Newark and the University of California, Los Angeles who have developed a highly accurate way to peer into the brain to uncover a person’s mental state and what sort of information is being processed before it reaches awareness. With this new window into the brain, scientists now also are provided with the means of developing a more accurate model of the inner functions of the brain.

As reported in the Oct. 2009 issue of Psychological Science, the findings obtained by Stephen José Hanson, psychology professor at Rutgers; Russell A. Poldrack, professor at UCLA, and Yaroslav Halchenko, (now a post-doctoral student at Dartmouth College), have provided direct evidence that a person’s mental state can be predicted with a high degree of accuracy through functional magnetic resonance imaging (fMRI). The research also suggests that a more comprehensive approach is needed for mapping brain activity and that the widely held belief that localized areas of the brain are responsible for specific mental functions is misleading and incorrect.

Over the last several years, much of neuroimaging has focused on pinpointing areas of the brain that are uniquely responsible for specific  mental functions, such as learning, memory, fear and love. But this latest research shows that the brain is more complex than that simple model. In their analysis of global brain activity, the researchers found that different processing tasks have their own distinct pattern of neural connections stretching across the brain, similar to the fingerprints that distinctively identify each of us. Rather than being a static pattern, however, the brain is able to arrange and rearrange the connections based on the mental task being undertaken.

“You can’t just pinpoint a specific area of the brain, for example, and say that is the area responsible for our concept of self or that part is the source of our morality,” says Hanson. “It turns out the brain is much more complex and flexible than that. It has the ability to rearrange neural connections for different functions. By examining the pattern of neural connections, you can predict with a high degree of accuracy what mental processing task a person is doing.“

The findings open up the possibility of categorizing a multitude of mental tasks with their unique pattern of neural circuitry and also represent a potential first, early step in developing a means for identifying higher-level mental functions, such as 'lying' or abstract reasoning. They potentially also could pave the way for earlier diagnosis and better treatment of mental disorders, such as autism and schizophrenia, by offering a means for identifying very subtle abnormalities in brain activity and synchrony.

The research showing that specific mental functions do not correspond directly with certain brain areas but rather a unique pattern of neural connections also provides a more accurate direction for mapping the effective connectivity of the brain. Known as the Connectome Project, the goal of researchers involved in that work is to provide a complete map of the neural circuitry of the central nervous system.

“What our research shows is that if you want to understand human cognitive function, you need to look at system-wide behavior across the entire brain,” explains Hanson. “You can’t do it by looking at single cells or areas. You need to look at many areas of the brain to even understand the simplest of functions.”

The study involved 130 participants, each of whom performed a different mental task, ranging from reading, to memorizing a list, to making complex decisions about whether to take monetary risks, while being scanned using fMRI. The researches were able to identify which of eight tasks participants were involved in with more than 80-percent accuracy by analyzing the participants’ fMRI data against classifications developed from the fMRIs of other individuals. The researchers also were able to identify what class of objects (faces, houses, animals, etc.) a person was viewing before he or she could report that information by analyzing the pattern of brain activity at the back of the brain where information is processed and then conveyed towards the frontal regions associated with awareness.

“It’s the same principle experienced during a car accident. The car accident actually happens tens of a milliseconds before you are aware you have actually been hit,” explains Hanson. “By looking at the back of the brain, we can 'read out,' for example, that a person is looking at dogs and cats before they actually know they are looking at a dog or a cat.”

Unlike most research that has focused on specific areas of the brain, Hanson and his team looked at the pattern of activity across a half million points in the brain. Interestingly, the patterns of neural networks involved in each of the eight tasks on the surface appear very similar. The reason, Hanson explains, is that various mental functions tend to draw on many of the same processes. For example, memorizing a list of words that include the word dog is likely to draw up a memory of a pet, the same as reading a story about a dog would. Using machine learning techniques (a support vector machine), capable of analyzing and categorizing large amounts of data, the researchers were able to identify those slight differences that allowed them to predict the specific mental function of the participants and what information they would report back.

“It’s like looking at two patterns of identical flower arrangements,” says Hanson. “They each may have the same flowers but they will not be arranged exactly in the same manner, consequently leading to slight differences in the overall pattern. Using the pattern analysis methods we have developed, there are clues that can be detected and pulled out.”

 As part of their continuing research, Hanson and his team plan to develop a system for identifying neural connectivity abnormalities to assist with the study of such mental disorders as attention-deficit hyperactivity and autism and to produce a handbook for many of the new tools used for pattern analysis and the classification of mental states based on neuroimaging data.

The research was funded with grants from the U.S. Office of Naval Research, the James S. McDonnell Foundation and National Science Foundation. The McDonnell Foundation recently awarded Hanson another $1 million for ongoing studies in this area.