Tag Archives: Big Data

A Big Data divide at the Times

David Brooks says Big Data matters, but perhaps not as much as people think:

Big data has trouble with big problems. If you are trying to figure out which e-mail produces the most campaign contributions, you can do a randomized control experiment. But let’s say you are trying to stimulate an economy in a recession. You don’t have an alternate society to use as a control group. For example, we’ve had huge debates over the best economic stimulus, with mountains of data, and as far as I know not a single major player in this debate has been persuaded by data to switch sides.

Paul Krugman takes a look and says, “Waittt a minute here:”

It would be lovely to live in a world in which the failure of interest rates to soar as predicted would lead Brian Riedl of Heritage and Niall Ferguson to concede that their anti-stimulus critiques of 2009 were based on a completely wrong model; in which the economic downturns that have followed austerity policies almost everywhere they have been applied would lead Alberto Alesina to concede that his work on expansionary austerity was probably flawed, and lead George Osborne to proclaim publicly that he led Britain down the wrong path. But such things very rarely happen, and the fact that they don’t happen has nothing to do with the limitations of data…

So yes, it has been disappointing to see so many people sticking to their positions on fiscal policy despite overwhelming evidence that those positions are wrong. But the fault lies not in our data, but in ourselves.

It’s a good point from Krugman, who’s also been quite busy dealing with other knuckleheads.

Enhanced by Zemanta

Obama’s data machine

2008’s “hope and change” morphed into “Big Data” in 2012:

In fact, the tech side was the only part of the Obama operation that could credibly be framed as a throwback to the old Hope and Change: Despite the slash-and-burn quality of the Obama reelection campaign as seen by America’s television viewers, the president’s 33 million Facebook fans “were experiencing a whole different campaign that was largely positive,” Goff explained at Harvard. “What they were experiencing was this uplifting stuff about supporting the middle class, about fighting for education, and that kind of thing.” And when you consider that Obama’s Facebook fans were themselves friends with 98 percent of Facebook users in the U.S.—“That’s more than the number of people who vote,” Goff said—then the Obamanauts can plausibly argue that, for many Obama voters, maybe 2012 wasn’t that different from 2008 after all.

Even more important, the nerd narrative gives the Obamanauts hope for the future. After their historic victory in 2008, they predicted that their candidate was so amazing that he could single-handedly transform Washington by sheer force of will. That obviously didn’t come to pass. But now they are making similar predictions—not because of their man but because of their machine. “Luckily for us, I don’t see anyone on the Republican side who understands what we did,” Bird told me in Cambridge before going on to explain not only his grand designs of electing another Democrat president in 2016, but also for turning Texas blue.