We are all Nate Silvers

While Hurricane Sandy rages through the East Coast, the political class, having exhausted our speculation about whether a storm helps or hurts (Romney, Obama, 2016 candidates, early voting) has turned once again to a nice young idea entrepreneur who makes his home at The New York Times. Nate Silver, proprietor of the 538 website, has become a polarizing figure for some and the ultimate source of comfort for others. Not twice in the past two days has a liberal friend emailed me seeking reassurance that Nate Silver's election forecasts are really accurate, right?

For some people, it's the fact that Silver's forecasts (he gives Obama a 75 percent chance of winning right now) haven't reflected the Mitt-mentum after the first debate. More on that in the second. The charge is that maybe Silver is just a biased Democrat who is using his Times platform to peddle false hope.

A Moneyball-style debate has broken out among political class elders, who think that Silver just doesn't understand how politics works. He doesn't hear the crack of a bat the way that other non-mathematical prognosticators do. He doesn't have a feel for the game. He hasn't been on the campaign trail much and doesn't speak very often to non-pollsters.  

Also, a bunch of people are jealous. Silver has become a celebrity. He has a fat book contract. He's making the rounds of the shows that liberals love to love. People are listening to him, and not listening to them.

Here is my take on Silver. 

1. As a Bayesian, his mind works in a way that assesses probability in a counter-intuitive way. His models account for both the base rates of a particular occurrence — what is the likelihood that a Republican could win a certain state by X many points given a bounded set of historical data — and factors it into his equations, which of course include more general data, like polling averages.

2. No one, not even Nate Silver, believes that you can predict the course of an election based on statistics. For one thing, elections are an amalgam of a trillion tiny choices, many of them contingent on random noise, and others that are simply immeasurable. For another, the "n," or amount of comparable data for past elections, is relatively small, and often the data are themselves subject to intense sociological cross-pressures that aren't reliable.

3. The basic way to read Silver, or any one polling expert's take on the election, is to accept it on its face. It is a good guess. It accounts for a lot of things that few of us have time to look at. It puts a numerical value on some stuff that generally resides within the guts of political reporters, which makes us very uncomfortable.  

But the truth is, every time WE make a prediction, we are doing what Nate Silver does, except we're using the quantum computer that is our brain, the data we've crunched is not conscious to us, and we use metaphors and descriptive language, rather than math, to express what amounts to a guess based on past probabilities.   

In other words, we are all Nate Silvers.