Nate Silver is most famous for steadily predicting Barack Obama’s reelection (which, as you may have heard, happened). Yet his new bestseller The Signal and the Noise: Why So Many Predictions Fail—But Some Don’t is a fine all-around introduction to the science and art of forecasting, with interesting examples drawn from many fields.
For example: You know those ten-day weather forecasts? Predicting the first week has gotten quite good, but the ninth and tenth days, Silver reports, are useless. They may even be negatively correlated with what actually transpires.
The Signal and the Noise starts weakly with the oft-told cautionary tale of how credit-rating agencies such as Moody’s and Standard & Poor’s missed the subprime mortgage bubble. Fortunately, it improves as the author turns to topics with which he has more personal experience such as sports, gambling, and sports gambling.
Indeed, The Signal and the Noise is one of the better Frequent Flyer books of recent years. Men don’t read books much anymore, but the one place you can find a fair number of guys with three-digit IQs and time on their hands is the airport. Hence, a relatively distinct genre has emerged in this century: nonfiction books that aren’t about business per se but imply they will familiarize you with conceptual techniques that could conceivably be applied to making money. Frequent Flyer classics include Malcolm Gladwell’s books; Freakonomics; Moneyball; and Thinking, Fast and Slow.
Silver’s entry into the Frequent Flyer genre shares many of the virtues of these books, such as a lucid and unobtrusive prose style. More impressively, Silver avoids their typical weakness: a lack of reality checking.
Gladwell has finally become notorious for seldom knowing what he’s talking about, but overconfidence infects the genre’s worthier exponents as well. For example, U. of Chicago economist Steven D. Levitt became famous in 1999 for theorizing that legalizing abortion cut crime 20 years later. I pointed out to him in our debate in Slate that the murder rate among juveniles born just after Roe v. Wade was several times higher than for the cohort born just before legalization. This did not faze Levitt, who simply repeated his assertion six years later in Freakonomics…to vast acclaim.
A half-year later, though, two obscure economists tried to replicate Levitt’s original calculations, only to discover that their celebrity colleague had simply botched them. This fiasco didn’t seem to hurt Levitt’s career, but few people care much about getting the past right. Nor do people bother terribly about the long-term future: You can make reasonably accurate predictions by looking at, say, immigration-driven demographic change, but there’s little market for that.
What people do get excited over is who is going to win current competitions. If Silver had fouled up his call of this month’s election the way Levitt messed up his most famous theory, Silver’s career would have suffered. So by the standards of Frequent Flyer writers, Silver is admirably cautious and levelheaded. The Signal and the Noise carries much advice, almost all of it good, about how not to get fooled when forecasting.
Getting the 2012 election right wasn’t hugely difficult for Silver because 90 separate polling firms published their results from which he created a weighted average. (Although Republicans whined that he was weighting the polls wrong, Silver’s model underestimated Obama’s share in the national vote.)
More impressively, he beat the Intrade prediction market (which the federal government banned earlier this week), even though punters could (and some certainly did) use his projections. Plus, prediction markets can use inside information.
Silver explains that he avoids highly competitive fields such as Wall Street. Instead, he prefers markets, such as poker, baseball, and politics in which he can prey upon the dim or under-motivated. For example:
Billy Beane [the hero of Michael Lewis’s Moneyball] got an awful lot of mileage by recognizing a few simple things, like the fact that on-base percentage is a better measure of a player’s offensive performance than his batting average. Nowadays pretty much everyone realizes that.
Silver has had four different careers in the 2000s—corporate drone, baseball stats whiz, professional poker player, and now the New York Times’ election prognosticator—all useful for a writer of airport books.
Silver started the century as a spreadsheet jockey for the accounting firm KPMG. Bored, he began building a humongous Excel file to predict the careers of baseball prospects. (His bosses naively “assumed I was diligently working on a highly elaborate model for one of our clients.”)
Silver isn’t quite as good a storyteller as Michael Lewis, whose Frequent Flyer Hall of Fame book Moneyball offers the charming story about how Oakland A’s general manager Billy Beane wrestled his underfinanced baseball team into the playoffs by using advanced statistics to find undervalued players. Lewis, however, left out the less-appealing news that Oakland had been Ground Zero of baseball’s steroids epidemic ever since Beane’s mentor Sandy Alderson had brought together Jose Cansecoand Mark McGwire in the 1980s.
Silver whiffed on the biggest baseball-stats story of his era. He didn’t mention steroids online until 2005, when he underestimated their effect. As late as May 2009, Silver wrote in Baseball Prospectus how surprised he was to hear that slugger Manny Ramirez, who had hit .396 after being traded to the Dodgers in 2008, had been caught by a PED test.
Although the word “baseball” appears on 50 pages of The Signal and the Noise, there is, unsurprisingly, no index entry for “steroids.”
There is a lone entry for “stereotype” in which Silver notes:
But poker players don’t have time for political correctness. Even if the stereotype that women play more conservatively than men is false 45 percent of the time, the fact that it might be true 55 percent of the time gives them something to work with.
You might think that a longer discussion of the abuses and uses of stereotypes would be relevant in a book on making predictions. But Frequent Flyer books are extremely politically correct because the end game for the author is less about selling books and more about personal appearances at corporate conferences. And HR departments are leery of letting un-PC experts speak. That’s why someone such as Gladwell makes vastly more money off speeches than does a data maestro such as Charles Murray.
After selling his forecasting system to Baseball Prospectus, Silver became obsessed with poker during that game’s recent fad. The rise and fall of his poker prosperity provides the best chapter in the book, even though Silver misses the obvious-in-hindsight link between the poker bubble and the subprime bubble. In 2003, only 839 people participated in the World Series of Poker in Las Vegas. In 2004, as soaring home prices in what Michael Lewis called the Sand States of Nevada, Arizona, and California turned mortgages into ATMs, there were 2,576 entrants. By 2006, there were 8,773.
Silver made about $400,000 during these years fleecing bad poker players online and at the Bellagio in Las Vegas. Yet from late 2006 to early 2007, Silver lost $135,000 as the “fishes” disappeared from the poker tables, leaving only the poker pros to feast upon each other. A few months into 2007, Silver cashed in and launched a new career as a political expert.
Silver attributes the end of the poker bubble to the Republican Congress regulating online poker. Hilariously, he says this Republican regulation increased his “interest in the political process” and “eventually led to the development of FiveThirtyEight.”
But a more fundamental reason for the poker bust that Silver still doesn’t notice would appear to be that home prices topped out in 2006, followed by the collapse of subprime lenders in the winter of 2007. As net worths sank, giddy Sand Staters stopped heading to Vegas to lose to gimlet-eyed pros such as Silver.
In other words, the poker bust was a leading indicator of the housing bust. The funny thing is that playing poker had given Silver the information he could have used to make the biggest, most profitable forecast of his lifetime: The subprime jig was up. (See Michael Lewis’s Frequent Flyer classic The Big Short for biographies of guys who made billions off accurate forecasts about the housing bubble.) Yet Silver missed it. In fact, he still doesn’t get it.
But don’t feel too sorry for poor Nate Silver. He’ll make plenty of money writing books and, especially, giving speeches. In fact, he’ll deserve the money more than most of his competition.
Copyright 2013 TakiMag.com and the author. This copy is for your personal, noncommercial use only. You can order reprints for distribution by contacting us at firstname.lastname@example.org.