Making computers reason and learn by analogy

Using cognitive science theories, Forbus and his collaborators have developed a model that could give computers the ability to reason more like humans and even make moral decisions. Called the structure-mapping engine (SME), the new model is capable of analogical problem solving, including capturing the way humans spontaneously use analogies between situations to solve moral dilemmas.

"In terms of thinking like humans, analogies are where it's at," said Forbus, Walter P. Murphy Professor of Electrical Engineering and Computer Science in Northwestern's McCormick School of Engineering. "Humans use relational statements fluidly to describe things, solve problems, indicate causality, and weigh moral dilemmas."

The theory underlying the model is psychologist Dedre Gentner's structure-mapping theory of analogy and similarity, which has been used to explain and predict many psychology phenomena. Structure-mapping argues that analogy and similarity involve comparisons between relational representations, which connect entities and ideas, for example, that a clock is above a door or that pressure differences cause water to flow.

Analogies can be complex (electricity flows like water) or simple (his new cell phone is very similar to his old phone). Previous models of analogy, including prior versions of SME, have not been able to scale to the size of representations that people tend to use. Forbus's new version of SME can handle the size and complexity of relational representations that are needed for visual reasoning, cracking textbook problems, and solving moral dilemmas.

"Relational ability is the key to higher-order cognition," said Gentner, Alice Gabrielle Twight Professor in Northwestern's Weinberg College of Arts and Sciences. "Although we share this ability with a few other species, humans greatly exceed other species in ability to represent and reason with relations."

Supported by the Office of Naval Research, Defense Advanced Research Projects Agency, and Air Force Office of Scientific Research, Forbus and Gentner's research is described in the June 20 issue of the journal Cognitive Science. Andrew Lovett, a postdoctoral fellow in Gentner's laboratory, and Ronald Ferguson, a PhD graduate from Forbus's laboratory, also authored the paper.

Many artificial intelligence systems -- like Google's AlphaGo -- rely on deep learning, a process in which a computer learns examining massive amounts of data. By contrast, people -- and SME-based systems -- often learn successfully from far fewer examples. In moral decision-making, for example, a handful of stories suffices to enable an SME-based system to learn to make decisions as people do in psychological experiments.

"Given a new situation, the machine will try to retrieve one of its prior stories, looking for analogous sacred values, and decide accordingly," Forbus said.

SME has also been used to learn to solve physics problems from the Advanced Placement test, with a program being trained and tested by the Educational Testing Service. As further demonstration of the flexibility of SME, it also has been used to model multiple visual problem-solving tasks.

To encourage research on analogy, Forbus's team is releasing the SME source code and a 5,000-example corpus, which includes comparisons drawn from visual problem solving, textbook problem solving, and moral decision making.

The range of tasks successfully tackled by SME-based systems suggests that analogy might lead to a new technology for artificial intelligence systems as well as a deeper understanding of human cognition. For example, using analogy to build models by refining stories from multiple cultures that encode their moral beliefs could provide new tools for social science. Analogy-based artificial intelligence techniques could be valuable across a range of applications, including security, health care, and education.

"SME is already being used in educational software, providing feedback to students by comparing their work with a teacher's solution," Forbus said. But there is a vast untapped potential for building software tutors that use analogy to help students learn."