Get AI summaries of any video or article — Sign up free
On These Math Problems, Smarter People Do Worse thumbnail

On These Math Problems, Smarter People Do Worse

Veritasium·
5 min read

Based on Veritasium's video on YouTube. If you like this content, support the original creators by watching, liking and subscribing to their content.

TL;DR

Correct answers in the skin-cream scenario depend on ratios (improved-to-worsened proportions), not on which group has the larger raw count of improvements.

Briefing

A counterintuitive pattern shows up when people answer quantitative questions: higher numeracy can make them more likely to get politically loaded problems wrong. The effect matters because it challenges the common belief that stronger math skills automatically lead to more accurate reasoning—especially when the “right” conclusion threatens or supports a person’s ideology.

The research begins with a simple proportional-reasoning trap using a fictitious skin-cream trial. Participants see a table counting how many people improved versus worsened after two weeks. Many people jump to an intuitive shortcut: whichever group has the larger raw number of “improved” cases must be better. But the correct interpretation depends on ratios. In the cream group, roughly three times as many people improved as worsened; in the control group, about five times as many improved as worsened. That means the cream, on average, made rashes worse—even though the “improved” count looks larger at first glance.

Dan Kahan and colleagues tested this with a nationally diverse sample of 1,111 Americans. Before answering, each participant took a numeracy assessment measuring quantitative reasoning rather than advanced math. When the skin-cream question used the “cream helps” framing, accuracy rose with numeracy in the expected direction—yet the higher-numeracy participants were also more likely to avoid the intuitive mistake and select the correct proportional answer. That part looks like numeracy doing its job.

The twist comes when the same proportional table is presented with reversed column headings, flipping which conclusion is correct. Again, higher numeracy predicts higher accuracy. But the study’s real target is politics: participants were split by self-reported political affiliation and then given either a gun-control version of the fictitious study or the skin-cream version.

For the apolitical skin-cream problem, liberals and conservatives follow the same accuracy pattern—no ideological split emerges. For the gun-control problem, the split is stark. When the data imply gun-control laws reduce crime, Democrats perform well and Republicans struggle; when the data imply gun-control laws increase crime, the pattern reverses. Crucially, numeracy no longer guarantees accuracy in the “threatening” direction. Among the most numerate participants, performance is worse than it should be: they become more likely to reach the conclusion that fits their prior beliefs rather than the conclusion demanded by the numbers.

The same conditional polarization appears across other issues like fracking and global warming, and even when reasoning ability is measured through science literacy or open-minded thinking. The broader takeaway is uncomfortable: people may use quantitative skill selectively—applying it to justify what they already believe—while still feeling rational.

The discussion closes with practical ideas for reducing tribal reasoning: avoid partisan rhetoric and focus on specific local policies; cultivate curiosity so people are more willing to examine evidence that conflicts with ideology. The emphasis is on awareness and accountability, not a magic fix—because the tendency to align beliefs with one’s group is deeply rooted in social survival, and it becomes more visible in today’s high-volume online information environment.

Cornell Notes

Quantitative reasoning can fail in predictable ways when politics is involved. In a fictitious skin-cream trial, correct answers depend on proportional reasoning (ratios of improved to worsened cases), and higher numeracy helps people avoid an intuitive but wrong shortcut. The pattern changes when the same style of data is embedded in a gun-control scenario where the correct conclusion conflicts with a party’s ideology. Then numeracy stops protecting accuracy: highly numerate participants are more likely to select the ideologically consistent interpretation rather than the one demanded by the numbers. The result is polarization that grows with reasoning skill, suggesting people may use quantitative ability to rationalize prior beliefs.

Why does the skin-cream question create a “smart people do worse” effect?

The task hinges on proportional reasoning. Participants see counts of improved versus worsened rashes in an experimental (cream) group and a control (no cream) group. A common shortcut is to compare raw “improved” numbers, which can suggest the cream helped. The correct method compares ratios: in the cream group, about three times as many people improved as worsened, while in the control group, about five times as many improved as worsened. That implies no cream was more likely to improve rashes, so the cream made outcomes worse on average.

How did the study measure numeracy, and what did it predict in the skin-cream version?

Numeracy was defined as the ability to reason well about quantitative information, not advanced math. The 1,111 participants took a numeracy assessment before answering. For the skin-cream framing, higher numeracy increased the fraction of participants who answered correctly, because better reasoners were more likely to avoid the intuitive “bigger number” mistake and apply the ratio logic required by the table.

What changes when the same proportional table is used for gun control?

The gun-control scenario keeps the structure of the data the same but changes the political meaning. Cities are divided into those with recent laws making concealed handgun carry illegal versus similar cities without such laws, and crime rates are tracked over a year. When the data imply gun-control laws reduce crime, Democrats perform better; when the data imply gun-control laws increase crime, Republicans perform better. The key finding is that numeracy no longer reliably improves accuracy in the “ideologically threatening” direction.

How does numeracy interact with ideology in the gun-control results?

When the correct answer conflicts with a participant’s ideology, higher numeracy can correlate with worse-than-expected accuracy. The transcript describes that for the most numerate participants, performance drops sharply relative to what would be expected if numeracy simply improved reasoning. Low numeracy participants are also affected, but the gap is larger for high numeracy—suggesting selective application of quantitative skill to justify prior beliefs.

What broader pattern links gun control to issues like fracking and global warming?

Polarization appears to be conditional on reasoning ability across multiple topics. As numeracy or science-related competence increases, polarization on political issues can increase rather than decrease. The transcript also notes similar effects when reasoning proficiency is measured through science literacy and actively open-minded thinking, indicating the phenomenon is not limited to one test or one domain.

What practical interventions are suggested to reduce this kind of polarization?

Two angles are highlighted. First, avoid partisan rhetoric: instead of loaded terms like “gun control” or “climate change,” focus on specific local policies and constructive solutions that don’t trigger tribal thinking. An example given is bipartisan action in southeast Florida on sea-level rise that avoids debating whether climate change is manmade and instead addresses local challenges. Second, foster curiosity, since increasing science curiosity is associated with less polarization compared with increasing science comprehension.

Review Questions

  1. In the skin-cream example, what ratio comparison leads to the conclusion that the cream made rashes worse?
  2. Why does numeracy help in the skin-cream task but fail to protect accuracy in the gun-control task when ideology is threatened?
  3. What does the transcript suggest about the relationship between science literacy, open-minded thinking, and political polarization?

Key Points

  1. 1

    Correct answers in the skin-cream scenario depend on ratios (improved-to-worsened proportions), not on which group has the larger raw count of improvements.

  2. 2

    Higher numeracy improves accuracy when the correct conclusion is not ideologically threatening, helping people avoid an intuitive but wrong shortcut.

  3. 3

    When the same quantitative structure is placed inside a political context, accuracy becomes conditional on party alignment rather than on numeracy alone.

  4. 4

    Highly numerate participants can perform worse than expected when the data contradict their ideology, suggesting selective reasoning or motivated interpretation.

  5. 5

    Polarization grows with reasoning skill across multiple issues, including gun control, fracking, and global warming, and also appears in measures like science literacy and open-minded thinking.

  6. 6

    Reducing tribal reasoning may require avoiding partisan rhetoric and emphasizing specific local policies, plus cultivating curiosity rather than only increasing technical comprehension.

Highlights

The skin-cream table looks like it favors the cream at first glance, but proportional reasoning flips the conclusion: the control group is more likely to improve rashes on average.
In the gun-control version, the same data structure produces opposite accuracy patterns for Democrats and Republicans depending on whether the correct answer supports or threatens their ideology.
Numeracy stops acting like a safeguard against error when political stakes are involved; the most numerate participants show the largest drop in accuracy in the ideologically threatening direction.
The transcript links the effect to a broader pattern: polarization can increase with science competence, unless curiosity is specifically cultivated.

Topics

  • Numeracy
  • Proportional Reasoning
  • Motivated Reasoning
  • Political Polarization
  • Gun Control

Mentioned