← Back to Library

Is the vibecession real — or is the survey broken?

Forget the narrative that Americans are living through a unique economic despair; Joel Wertheimer argues that the data we trust to tell us how we feel is fundamentally broken. This piece cuts through the noise of the so-called "vibecession" by exposing a critical flaw in the University of Michigan's consumer sentiment survey, suggesting that what looks like a depression-level crash in confidence is actually an artifact of methodological failure and partisan skew.

The Broken Gauge

The core of Wertheimer's argument rests on the idea that we are misreading the economic mood because our primary thermometer has been recalibrated without us noticing. He writes, "Failure to correct for these issues has led to plenty of pet theories — but they explain a trend that may not even exist." This is a bold claim: it suggests that years of analysis regarding why Americans feel poor despite strong GDP numbers are based on faulty premises.

Is the vibecession real — or is the survey broken?

The survey in question, the Index of Consumer Sentiment (ICS), recently reported a reading of 49.5, a figure lower than anything seen during the Great Recession. Wertheimer dismantles this headline immediately: "No, Americans are not as unhappy about the economy as they were during the Great Recession." He attributes this distortion to two converging forces: the shift from phone polling to web-based surveys and a massive imbalance in party representation within the sample.

The transition to online polling, which became fully web-based by July 2024, introduced a persistent "mode effect." Wertheimer notes that while the University of Michigan found a high correlation between the old phone data and new web data, this masked a significant drop in sentiment scores. He explains, "A high time-series correlation only means the phone and web series moved together; it does not rule out a persistent level shift, with web respondents consistently registering lower sentiment." This is a crucial distinction for any data consumer to understand; moving trends do not guarantee accurate absolute values.

The vibecession is partly an artifact of bad data.

This methodological shift coincided with a dramatic change in the political makeup of the respondents. As partisanship has deepened, the gap between how Democrats and Republicans view the economy has widened to nearly 53 points under the current administration. Wertheimer argues that the survey sample now contains far too many Democrats, particularly because the rotating panel design retains Democratic respondents at higher rates than Republican ones after the switch to web polling.

Critics might note that independents often drive sentiment in these surveys and that their dissatisfaction is real regardless of party lines. However, Wertheimer counters this by showing that when he reweights the data using Pew's National Public Opinion Reference Survey (NPORS) to reflect actual partisan demographics, the picture changes drastically.

Correcting the Lens

To fix the broken signal, Wertheimer turns to a less famous but more robust dataset. He describes the NPORS as "perhaps the most important poll you've never heard of," using it to recalibrate the Michigan survey's skewed sample. When he applies these corrections—adjusting for both the web-mode effect and the partisan imbalance—the sentiment score jumps significantly.

"When adjusted for these issues, the ICS should be substantially higher than the Great Recession lows we have witnessed over the past year," he writes. Instead of a depression-era trough, the corrected data places current sentiment in line with 2013, a period characterized by slow growth and stubbornly high unemployment but not economic collapse.

This adjustment aligns the Michigan numbers with other major confidence indices from the Conference Board, Gallup, and YouGov. The implication is profound: the "vibecession" isn't a mystery of psychology; it's a failure of measurement. As Wertheimer puts it, "The switch to online polling made responses more negative and... There are too many Democrats in the sample." He argues that the current administration faces a unique challenge where economic data is being filtered through a lens of intense partisan polarization, making objective assessment nearly impossible without statistical intervention.

This analysis resonates with the concept of Goodhart's law, which posits that when a measure becomes a target, it ceases to be a good measure. Here, the survey has become so entangled in political expression and methodological drift that it no longer measures pure economic sentiment. The University of Michigan's own leadership defends the data, with Joanne Hsu claiming the readings are "fully aligned with the views of independents." Yet Wertheimer's charts suggest otherwise, showing a divergence that tracks closely with a hypothetical sample containing twice as many Democrats as Republicans.

No, Americans are not as unhappy about the economy as they were during the Great Recession.

The stakes of this error are high. If policymakers and markets believe sentiment is at historic lows, it could trigger unnecessary defensive measures or mislead strategic planning. Conversely, if the public believes their pessimism is validated by "gold standard" data that is actually skewed, it entrenches a sense of doom that may not reflect reality.

Bottom Line

Wertheimer makes a compelling case that the narrative of a unique economic gloom is largely a statistical illusion created by a survey that has failed to adapt its weighting for the modern political and technological landscape. While his reliance on Pew data as a corrective is strong, the ultimate vulnerability lies in whether other polling institutions can replicate this adjustment quickly enough to shift the public discourse before the next election cycle locks in these distorted perceptions.

Deep Dives

Explore these related deep dives:

  • Public choice

    This concept explains the 'partisan expressive response' mechanism where respondents use economic surveys to signal political identity rather than report objective financial conditions, directly undermining the article's critique of the ICS data.

  • Roper Center for Public Opinion Research

    The article cites this specific University of Michigan project as a methodological fix; understanding its design reveals how researchers are attempting to correct for the non-response bias that has skewed recent sentiment readings.

  • Goodhart's law

    While not explicitly named, the article describes a scenario where a metric (consumer sentiment) becomes distorted once it is used as a primary indicator of economic health, illustrating this famous principle in real-time polling data.

Sources

Is the vibecession real — or is the survey broken?

by Nate Silver · · Read full article

Today’s newsletter is a guest post from Joel Wertheimer. Joel is a civil rights attorney in New York and has served as a policy consultant to political candidates. He worked for President Obama from 2015 to 2017 as Associate Staff Secretary. He irregularly writes about data, soccer and politics at wertwhile.substack.com..

For nearly four years, the internet has debated whether we’ve been mired in what Kyla Scanlon dubbed a “vibecession” — whether people feel worse about the economy than the underlying data suggests they “should” feel. People as esteemed as Nobel laureate Paul Krugman have frequently posted about the vibes mystery. Nate wrote a whole piece about the divergence in the New York Times two years ago.

But there’s one big problem with the discussion: most of the participants are relying on a broken survey, the University of Michigan’s consumer sentiment survey (“Index of Consumer Sentiment” or “ICS”), that is in dire need of being repaired. Failure to correct for these issues has led to plenty of pet theories — but they explain a trend that may not even exist.

On Friday, the survey reported a 49.5 reading for consumer sentiment, a number that, while slightly improved from last month, puts it below the depths of the Great Recession. But without properly correcting for the survey’s issues, the headlines are misleading. No, Americans are not as unhappy about the economy as they were during the Great Recession.

What’s wrong with the University of Michigan survey.

The University of Michigan ICS is the gold standard sentiment survey measuring consumer sentiment.1 The survey has historically shown a very strong correlation with “hard” economic data such as inflation and unemployment. But before more bad analysis gets done on the vibecession, people need to know they’re working with dubious data. As with election polls, the ICS has struggled amid a shift away from telephone polling. There are issues both with partisan nonresponse, with some political groups more likely to respond than others, and partisan expressive response, with survey-takers using questions about the economy to express political sentiment.

So the problems with the ICS are these:

The switch to online polling made responses more negative and,

There are too many Democrats in the sample.

Thus, ICS data since mid-2024 is not comparable to past periods. Here is the partisanship of the sample over time:

And Democrats right now say they hate the economy with Trump ...