← Back to Library

What to make of Michigan

Nate Silver delivers a rare, unvarnished autopsy of a political primary that defied every pollster's model, challenging the very reliability of the data driving modern political strategy. While the headlines focus on Abdul El-Sayed's narrow victory, Silver argues the real story is a systemic failure of polling in congressional primaries that could mislead the Democratic Party into dangerous overconfidence or unnecessary panic. This analysis is critical for any strategist trying to separate signal from noise in an election cycle defined by volatility.

The Illusion of Certainty

Silver opens by dismantling the narrative that the polls were merely "close." He notes that the discrepancy was not a statistical fluke but a massive deviation from the consensus. "The last seven surveys of the race as tracked by the New York Times had El-Sayed up by margins ranging between 10 and 19 points," he writes, contrasting this sharply with the actual 1.4-point margin. This isn't just a missed prediction; it is a fundamental breakdown in the industry's ability to measure voter intent in complex, low-turnout environments.

What to make of Michigan

The author suggests that the campaign itself contributed to this confusion by leaking internal data that created a false sense of security. Silver observes, "I don't understand the utility of publishing internal polls showing yourself ahead by double digits — personally, if I ran a campaign, I'd make it a strict policy to never release internal polls, which are often highly misleading." By releasing these numbers, the El-Sayed campaign may have inadvertently solidified a narrative that collapsed under the weight of reality. This move reflects a broader trend where campaigns treat polling as a messaging tool rather than a strategic compass, a dangerous game when the stakes are high.

"Many people, including traders at prediction markets, tend to be much too crude in the heuristics they apply toward polling error, failing to recognize that polling is relatively accurate in some types of races but routinely quite inaccurate in others and that much of this is predictable."

Silver's critique extends to the financial markets that bet on these outcomes. He points out that prediction markets often suffer from overconfidence, treating their algorithms as oracles rather than probabilistic tools. He notes that historically, the average error in presidential primary polls is around 9 points, but in congressional primaries, the error could be double that. This variance is often ignored by traders who assume a uniform level of accuracy across all races, leading to a false sense of precision in their forecasts.

The Mechanics of the Miss

Why did the models fail so spectacularly? Silver breaks down the specific demographic and methodological hurdles unique to Michigan. He explains that the race involved a difficult mix of voters: "Stevens' best groups were probably rural white voters and working-class Black voters, two groups that are notoriously hard to reach in surveys." Meanwhile, El-Sayed's base relied on younger voters who historically underperform in primaries, creating a classic "Shy Tory" dynamic where the true support for one candidate was hidden from pollsters.

The author also highlights the specific challenge of the Arab-American population in Michigan. "Michigan has a reasonably large Arab-American population, but not large enough to yield a reliable crosstab in (say) a 600-person survey, so instead Arab-Americans routinely fall between the cracks in opinion research." This sampling error is not a minor detail; it represents a structural blind spot in how political data is collected in diverse states. When a significant voting bloc is systematically underrepresented in the data, the resulting model is inherently flawed.

Silver further argues that the discourse surrounding polling has become counterproductive. He notes, "There can sometimes be cases of the blind leading the blind in polling, producing a lot of herding toward a sometimes very wrong consensus." When pollsters see others reporting similar numbers, they may unconsciously adjust their own methodologies to align with the group, reinforcing a shared error rather than correcting it. This herding behavior creates a feedback loop that makes the consensus appear more robust than it actually is.

The Political Fallout

The implications of this narrow victory extend far beyond Michigan. Silver warns that the result places the Democratic establishment in a precarious position. "Instead of accepting that they have a lot of problems, they're going to ask what they might have done differently," he writes. The establishment may view the result as a fluke or a result of specific candidate weaknesses rather than a sign of deeper structural issues within the party's coalition.

He contrasts this with the broader national trend, noting that while progressives are rising, the variance is significant. "The media likes simple narratives, and 'progressives rising' is by no means wrong, but nobody should be bending the knee at this point." The party cannot simply assume that a progressive wave will carry every candidate; the specific dynamics of each race matter immensely. A counterargument worth considering is that the establishment's hesitation to endorse Stevens may have actually helped El-Sayed by allowing him to frame the race as an anti-establishment crusade, a dynamic Silver hints at but does not fully explore.

"Tonight is probably bearish for Democrats in the general election, but I wouldn't overstate that. I've always thought people are too eager to derive implications about general election strength from primary results."

Silver cautions against reading too much into primary results as a proxy for general election strength. He argues that the shift to the left in the primary is partly due to moderate voters leaving the party, meaning El-Sayed now faces the difficult task of winning back those moderates in November. This nuance is often lost in the immediate post-primary analysis, where the focus is entirely on the intra-party battle.

Bottom Line

Silver's most powerful contribution is his insistence that the polling industry's confidence is misplaced and that the "Shy Stevens" phenomenon reveals a deeper flaw in how we measure political support. His analysis holds up under scrutiny, particularly his breakdown of the demographic blind spots in Michigan polling. However, the piece could have gone further in exploring how the establishment can actually rebuild trust with the progressive base without alienating the moderates they need to win. The reader should watch for how the party navigates this tension in the coming months, as the gap between primary enthusiasm and general election viability remains the critical variable.

Deep Dives

Explore these related deep dives:

  • 2018 Michigan gubernatorial election

    The article uses El-Sayed's 22-point primary loss in this specific race to contextualize the surprise of his current Senate victory and challenge assumptions about his electability.

  • Favourite-longshot bias

    This betting market phenomenon explains the discrepancy between the article's observation of prediction markets declaring a near-certain win and the actual narrow margin of victory.

  • Shy Tory factor

    The article's discussion of polls overestimating El-Sayed's lead by 10-19 points mirrors this classic polling failure where respondents conceal support for a less popular candidate.

Sources

What to make of Michigan

by Nate Silver · · Read full article

It’s just past 4 a.m. here on the East Coast, and as I write this, Abdul El-Sayed leads Haley Stevens by only 1.4 points in the Democratic primary for U.S. Senate with 95+ percent of the vote counted in Michigan. The margin is narrow, but when there aren’t a lot of votes left, will be hard for Stevens to make up. El-Sayed has been declared the winner by NBC News, and is considered the almost certain victor by prediction markets, but other news outlets haven’t called the race yet. I’ve never been much of an election night modeling guy — my whole thing is pre-election forecasts — so I’m not going to offer an opinion about whether NBC and the prediction markets got ahead of themselves. Most of you will probably read this in the morning, and the results may be clearer by then, but the points I’ll make in this newsletter aren’t particularly contingent on the exact final result.

However, this is one of those cases where the headline doesn’t tell the whole story. A 1- or 2-point win for El-Sayed would be much narrower than the results predicted by polls; the last seven surveys of the race as tracked by the New York Times had El-Sayed up by margins ranging between 10 and 19 points. I will note that an earlier Glengariff Group poll had Stevens ahead by 7, which is actually likely to end up closer to the end result than most of the other surveys, though it was pretty far off, too.

I’ve been putting the finishing touches on our midterms model, and that’s been going well; it should launch (early) next week. But I wrote some notes to myself while following Michigan in the background over the course of the evening. Considering the hour, I’m mostly just going to reproduce those with some uncharacteristic brevity.

11 quick thoughts on the Michigan result.

We should start by acknowledging that an El-Sayed win by any margin is a significant accomplishment. It’s not exactly surprising, given the success of more progressive candidates elsewhere and that he’s been ahead in the polls for a couple of months now. But this is a guy whose only previous attempt at elected office resulted in a 22-point loss to Gretchen Whitmer in the 2018 Michigan gubernatorial primary. Michigan, where I’m from, isn’t New York City or some super liberal district in Colorado. ...