Crowdsourced tool for depression

In a study involving 166 subjects who had exhibited symptoms of depression, the researchers compared their tool with an established technique known as expressive writing. The new tool yielded better outcomes across the board, but it had particular advantages in two areas: One was in training subjects to use a therapeutic technique called cognitive reappraisal, and the other was in improving the mood of subjects with more severe symptoms.

"We really wanted to see two things," says Rob Morris, who led the work as a PhD student in media arts and sciences at MIT. After graduating in February, Morris is now commercializing the technology through a New York-based company he co-founded, called Koko. "Could people get clinical benefits from it? That's hypothesis one," he says.

"Hypothesis two is, 'Will people be engaged and use this regularly?'" Morris adds. "There's a lot of great work in building web apps and mobile apps to provide psychotherapy without a therapist in the loop -- it's these self-guided programs. There's almost a decade of research showing that these things can produce really profound improvements for people. The problem is that, once you release them out into the wild, people just don't use them. The way we designed our platform was to really mimic some of the interaction paradigms that underlie very engaging social programs."

On that score, too, the results of the study were encouraging. The average subject in the control group used the expressive-writing tool 10 times over the three weeks of the study, with each session lasting about three minutes. The average subject using the new tool logged in 21 times, with each session lasting about nine minutes.

Buggy thinking

Morris; his thesis advisor, Rosalind Picard, an MIT professor of media arts and sciences; and Stephen Schueller, a clinical psychologist at Northwestern, describe the study in a paper appearing this week in the Journal of Medical Internet Research.

Morris, who had majored in psychology as an undergrad at Princeton University, initially enrolled in a PhD program in psychology in California. But he concluded that a traditional psychology program wouldn't grant him enough latitude in researching the therapeutic potential of information technology, a topic that quickly captured his interest. So he applied instead to do graduate work in Picard's Affective Computing Group, which specifically investigates the intersection of computing technologies and human emotions.

"I was at MIT without an engineering degree and really trying to race to learn computer programming," Morris recalls. He found himself spending a lot of time on a programmers' question-and-answer site called Stack Overflow. "Whenever I had a bug or was stuck on something, I would go on there, and almost miraculously, this crowd of programmers would come and help me," he says. "It was just this intuition that, just as we can get people on Stack Overflow to help us identify and fix bugs in code, perhaps we can harness a crowd to help us fix bugs in our thinking."

People suffering from depression frequently exhibit what Morris describes as "maladaptive thought patterns": You lose your job, and you conclude that you'll never find another one; your roommate comes home and shuts herself up in her room, and you assume it's because of something you've done.

Psychologists have sorted these thought patterns into categories. Predicting your future unemployability is an instance of "fortune-telling"; assuming you know your roommate's motivations is "mind-reading." Others include "overgeneralization," "catastrophizing," and "all-or-nothing thinking."

Cognitive reappraisal involves, first, identifying maladaptive thought patterns and, second, trying to recast the events that precipitated them in a different light: The job you lost offered no room for promotion and wasn't aligned with your interests, anyway; your roommate has been having trouble at work and may have just had a fight with a colleague.

Strength in numbers

A user of the new tool -- which Morris calls Panoply -- logs on and, in separate fields, records both a triggering event and his or her response to it. This much of the application was duplicated exactly for the expressive-writing tool used by the control group in the study.

With Panoply, however, members of the network then vote on the type of thought pattern represented by the poster's reaction to the triggering event and suggest ways of reinterpreting it. As users demonstrate more and more familiarity with techniques of cognitive reappraisal, they graduate from describing their own experiences, to offering diagnoses of other people's thought patterns, to suggesting reinterpretations.

"We really wanted to see that people are utilizing this skill over and over again, not only in response to their own stressors but also as teachers to other people," Morris says. "We can surmise that it's a little easier to practice some of these psychotherapeutic skills for other people before turning them toward themselves. But we don't have data supporting that."

For their study, Morris, Picard, and Schueller recruited subjects who described themselves as under stress, something that correlates highly with depression. Volunteers were asked to complete three questionnaires. One is a depression measure that's standard in the field. Another assesses perseverative thinking, and the third assesses skill at cognitive reappraisal. After three weeks using either Panoply or the expressive-writing tool, the subjects again completed the same three questionnaires.

Network effects

To simulate a large network of users -- and ensure that Panoply users would receive replies even if they were posting in the middle of the night -- Morris hired online workers through Amazon's Mechanical Turk crowdsourcing application to supplement the comments made by study subjects. Each Mechanical Turk worker received a brief training in cognitive reappraisal, and about 1,000 contributed to the study.

"It took a lot of time to figure out how to teach people these skills and give them examples of what to do in a way that is easily understood in a handful of minutes," Morris says. "Some of them wanted to sign up afterwards. They were like, 'Wow, I never knew I had these bugs in my thinking, too.'"