John Gottman
Gottman is the psychologist profiled in “Blink” who analyzes couples’ interactions and predicts whether they’ll get divorced. Sadly, Laurie Abraham notes in Slate that his methodology wasn’t everything Malcolm Gladwell made it out to be:
So what does it mean to predict divorce? For the 1998 study, which focused on videotapes of 57 newlywed couples, I assumed that Gottman had, in the first instance, sorted them into three groups—will divorce, will be happy, will be unhappy but still married—based on the conflict-variables he believed distinguished marriages that last from those that don’t (contempt, little positive affect, elevated male heart rate, etc.). Then, at six years, he’d checked to see how right, or wrong, his predictions had been. That isn’t how it worked. He knew the marital status of his subjects at six years, and he fed that information into a computer along with the communication patterns turned up on the videos. Then he asked the computer, in effect: Create an equation that maximizes the ability of my chosen variables to distinguish among the divorced, happy, and unhappy.
The upshot? What Gottman did wasn’t really a prediction of the future but a formula built after the couples’ outcomes were already known. This isn’t to say that developing such formulas isn’t a valuable—indeed, a critical—first step in being able to make a prediction. The next step, however—one absolutely required by the scientific method—is to apply your equation to a fresh sample to see whether it actually works. That is especially necessary with small data slices (such as 57 couples), because patterns that appear important are more likely to be mere flukes. But Gottman never did that. Each paper he’s published heralding so-called predictions is based on a new equation created after the fact by a computer model.
It gets worse when she tackles his accuracy rate, and its failure to account for false positives and false negatives. Bummer.
