← Back to Library

The problem with iq tests

The Origin Story

This piece stands out because it tells the story most people don't know: where IQ actually came from, and what it's supposed to measure. Derek Muller does something few creators do — he takes us inside an official IQ test while explaining the century-long debate over what intelligence means.

Muller writes that "the correlations weren't perfect" — this is the crucial detail that makes Spearman's discovery stick. He explains that after finding students who did well in math also did well in English, "Spearman proposed that each person has some level of general intelligence what he called the G Factor." The G Factor was meant to capture "how quickly students could learn new material, recognize patterns and think critically regardless of the subject matter."

The problem with iq tests

This is the intellectual heart of the piece. The author makes a compelling case that IQ isn't just a number — it's a theoretical construct designed to explain why scores across subjects correlate. What makes this argument land well is how Muller builds it: he starts with school grades, then expands into mental age, then shows how modern tests normalize scoring so "the mean was 100 and the standard deviation was 15."

The Predictor Problem

The most surprising evidence Muller brings isn't about test design — it's about what IQ actually predicts. He cites a 2005 meta-analysis showing "a correlation of .33 between IQ and brain size" — meaning high IQ is literally big brain. But wait, there's more: "their performance on an IQ test when they were 11 correlated with their performance 5 years later on the GCSE" at about .8 — "that's an extremely high correlation." This means two-thirds of variation in school exam scores could be predicted by IQ tests taken five years prior.

The income data is weaker, though Muller doesn't hide this. He cites a meta-analysis finding "the correlation between IQ and income to be .21" which means only 4.4% of variance explained. His paraphrase captures the key insight: "economically intelligence is not necessarily that highly rewarded." This is the kind of honest admission that makes the piece trustworthy — he's not overselling the predictive power.

But the mortality finding is stark: for every 15-point increase on the IQ test, you are "27% more likely to still be alive at age 76."

IQ tests all the questions are completed under time pressure — you may have only around 10 to 30 seconds per question.

The Dark History

Here's where Muller gets genuinely important: IQ has a dark history, and he doesn't gloss over it. "In France Benet believed intelligence could be improved through education" — the original test was designed so struggling students could get help to catch up. But "in the US the modified test was given to adults to rank them by intelligence." This shift from helping to ranking is the crux of the critique.

Muller notes that "researchers like Spearman believed that g was unchangeable" — that whatever general intelligence you were born with, you would have for the rest of your life. Critics might note this oversimplifies the nature of cognitive development — modern neuroscience shows neuroplasticity allows brains to change well into old age.

Bottom Line

Derek Muller's strongest contribution is making the abstract concrete: he takes an IQ test himself, walks through Raven's Progressive Matrices, and explains correlation coefficients with actual numbers. His biggest vulnerability is that the piece sometimes prioritizes breadth over depth — the history of IQ testing deserves a full episode, not a sub-section. The reader should watch for this: the debate over whether intelligence is fixed or trainable remains unresolved, and it's far more contested than this piece suggests.

Deep Dives

Explore these related deep dives:

Sources

The problem with iq tests

by Derek Muller · Veritasium · Watch video

in popular culture the term IQ is everywhere do IQ exams do that you probably need 120 points of IQ don't my IQ low IQ individual people who post about their IQ are losers when people say IQ what they mean is intelligence an objective rigorous measurement of intellectual ability but does it actually work well in this video I want to find out where IQ came from what does it actually measure what can it predict about your life and I guess what is my IQ I have never taken an official IQ test before honestly I don't think I'm terribly smart I've always kind of considered my IQ to be maybe just a little above average exothermic or endothermic I feel like that should be exothermic good job Science Guy there are a lot of IQ tests online but I am very skeptical about their accuracy still I figured some of them may be good practice for the real thing tomorrow I'm going to do an IQ test for real before I do that I want to try to improve my score and so I'm going to try to do a whole bunch of practice tests I think this test is trainable but tomorrow we're going to see whether that's true or not the idea of intelligence testing goes back hundreds of years but the first concrete breakthrough occurred in 1904 English psychologist just Charles Spearman was studying students grades in different subjects and he wondered how their performance in one subject like English would relate to their performance in another like math one option would be that the better a student did in math the worse they would do in English maybe because they spent more time on their math work and so had less time to devote to English so performance in different subjects would be negatively correlated another option was that performance in one subject would be completely unrelated to Performance in another after all different subjects require different skill sets so maybe marks would be totally uncorrelated the third option was that the better a student did in math the better they would do in English in other words their marks would be positively correlated a correlation coefficient can vary anywhere from negative-1 to positive 1 a correlation coefficient of negative 1 indicates a perfect negative correlation meaning an increase in one variable corresponds ...