Put On A Happy Face: Happy Digital Characters Sell More Than Sad Ones

New Ohio State University research suggests that the simulated emotions of digital characters on web sites might have a real impact on the potential customers that view and interact with them.

The study, appearing in the International Journal of Human-Computer Studies, found that digital characters might be better merchants if they act consistently happy, even if the products they're selling—such as novels—are heart-wrenchingly sad.

Li Gong , an assistant professor of communication who conducted the research, believes his study of digital characters is important for many applications, especially electronic commerce, learning, and entertainment.

Many Web sites feature digital human-like characters, also called avatars or agents. These digital humans can help put a face on Web sites that sell products. Although the characters can “read” text with a certain emotion, such as happy or sad, they can't automatically detect emotion from sentence to sentence with today's technology. And that can affect how well they perform..

Gong's research suggests people are more influenced by happy characters.

Gong believes the work might also significantly impact the computer gaming industry, which uses countless computer characters. “People playing these games want characters to have emotion,” he said. Gong believes the explanation for this desire is that “emotion is an indispensable element in human communication” and is becoming more essential as the use of digital characters grows.

The research involved the emotionally expressive character called “ Baldi ,” an animated human face who can also talk using text-to-speech software. Baldi, created by the Perceptual Science Lab at the University of California, Santa Cruz, can synchronize its lips perfectly to a passage of text while reading aloud in a way that conveys a specific emotion.

In this study, one “sad” version of Baldi consistently frowned and sounded sad while reading both sad and happy book reviews for participants. Another “happy” version always smiled and sounded happy while reading both happy and sad book reviews for other participants. The happy Baldi spoke quickly with a high voice and with more range in pitch while the sad version spoke in a lower, slower tone with little change in pitch.

When it came to having Baldi read reviews, Gong found study participants preferred the “happy” version compared to the “sad” talking face, regardless of whether the actual book review was happy or sad.

“When a digital character can't pick up emotional cues in text, it's better to be happy, even if the topic or product is sad,” Gong said. “The age-old idea that positivity outweighs negativity also applies here.”

But the reactions of putting on a happy face didn't end there. “Participants said they were more likely to read a book presented by the happy face compared to the sad one,” Gong said. The participants liked a happy Baldi more, felt it was more competent, and trusted it more than they did a sad version.

Although participants' responses to Baldi were lukewarm overall, Gong believes the happy face's stronger influence is an important finding. “Baldi is a laboratory version that looks quite strange. It's not a customer-friendly version,” Gong said. “But this fact makes the findings more powerful because people should react more strongly to realistic-looking characters you find on the Internet.”

While the research has immediate applications for talking faces, Gong is already looking into other aspects of digital characters.

In an upcoming study to be published in the April issue of Human Communication Research , Gong and Stanford University's Clifford Nass looked more closely at the humanness of characters. The researchers mixed and matched Baldi's face and a real person's videotaped face with a human voice or computerized voice.

The results? Mismatched talking faces—such as a human face speaking with a computerized voice or a computerized face speaking with a human voice—made participants less likely to share personal information compared to consistently matched versions.

As for the future, Gong is currently researching digital humans in the context of race. He believes investigating how people perceive the race of digital characters will shed new light on understanding the strengths and boundaries of racial beliefs and attitudes.

“Digital characters are becoming increasingly important as more kids grow up with computers,” Gong said. “Over a decade ago people started paying attention to digital beings. There's been a strong linear expansion of their use that we can't ignore.”