Get AI summaries of any video or article — Sign up free
Why Theories of Everything Keep Failing thumbnail

Why Theories of Everything Keep Failing

Sabine Hossenfelder·
5 min read

Based on Sabine Hossenfelder's video on YouTube. If you like this content, support the original creators by watching, liking and subscribing to their content.

TL;DR

A credible theory of everything must unify all four fundamental interactions and also explain the quantum measurement process, including how detectors produce outcomes.

Briefing

Physicists keep missing a “theory of everything” because many proposed frameworks don’t actually explain what a measurement is in quantum physics—so they can’t truly unify nature in the way the term implies. A genuine theory of everything should combine electromagnetism, the strong and weak nuclear interactions, and gravity into one framework. The first three are quantum theories, while gravity is not, and the missing piece is the quantum measurement process: detectors are built from particles described by the Standard Model, yet the measurement mechanism is left out in essentially every popular candidate. String theory is singled out as an example that still doesn’t deliver a workable account of how measurements occur, leaving a core explanatory gap at the heart of any claimed unification.

A second reason these projects stall is that a single common framework may be unnecessary to resolve the known tension between the Standard Model and general relativity. The mismatch is real—quantum theory and gravity don’t currently fit together cleanly—but giving gravity quantum properties (as in loop quantum gravity or asymptotically safe gravity) doesn’t automatically require folding everything into one unified mathematical structure. That matters because forcing a universal framework introduces ambiguity: if the mathematical assumptions aren’t dictated by necessity, researchers end up choosing structures they find appealing. The result is guesswork dressed up as theory, with examples like Garrett Lisi’s E8 and Eric Weinstein’s geometric unity criticized for adding extra assumptions based on preferred mathematical scenery rather than constraints that follow uniquely from the physics.

Third, many proposals quietly assume the target is final and complete—able to work at all energies with no deeper layer underneath. That “no open questions left” stance may be too ambitious. Instead of treating the Standard Model plus gravity as the last stop, it may be more realistic to combine them while allowing that the combined framework could still be incomplete.

Finally, the most fashionable requirements—especially beauty and simplicity—may be steering the search away from what nature actually allows. Naturalness is highlighted as one such assumption: if the universe doesn’t respect that aesthetic criterion, theories built on it are likely to miss the mark. Symmetry-based constructions face a related challenge: even if symmetries work well in the Standard Model, it’s worth asking where those symmetries come from, or whether they emerge rather than being fundamental.

Against that backdrop, the most promising approach on offer is described as Penrose’s gravitationally induced collapse. The appeal is practical and conceptual: it takes the measurement problem seriously, includes both gravity and quantum ideas, avoids claiming to be a final theory, and doesn’t rely on extra symmetries or “natural” constants. While a related Penrose–Diósi model has been experimentally ruled out, the critique is that the ruled-out version is non-local and not generally covariant—features that make it unsurprising it failed. Penrose’s original idea is portrayed as different in spirit and not subject to the same dismissal. The broader takeaway is that the recurring failures stem less from a lack of effort and more from structural omissions—especially around measurement—and from overconfident assumptions about what a “complete” theory must look like.

Cornell Notes

Many “theories of everything” fail because they don’t deliver a full quantum account of measurement while claiming to unify all fundamental interactions. A true theory of everything must combine electromagnetism, the strong and weak nuclear forces, and gravity, but most proposals leave out how detectors (made of Standard Model particles) produce measurement outcomes. Another problem is that a single unified mathematical framework isn’t strictly required to address the Standard Model–general relativity tension; forcing one can lead to arbitrary extra assumptions. Many approaches also assume the Standard Model plus gravity is final and complete, and they often build in aesthetic constraints like naturalness and symmetry. The most promising alternative highlighted is Penrose’s gravitationally induced collapse because it treats measurement seriously, brings gravity into quantum physics, and avoids “final theory” and extra-assumption claims.

What does a “theory of everything” need to explain, beyond unifying forces?

It should combine electromagnetism, the strong and weak nuclear interactions, and gravity into one framework. Since the first three are quantum theories, the framework must also address the quantum measurement process. Detectors are made of particles described by the Standard Model, so a credible theory of everything should explain how measurements work using that quantum-mechanical machinery—yet the measurement process is missing from essentially all proposed theories discussed.

Why is a common unified framework considered potentially unnecessary?

The Standard Model and general relativity disagree because the Standard Model has quantum properties while general relativity does not. Resolving that tension can be done by giving gravity quantum properties without necessarily merging everything into one shared framework. Loop quantum gravity and asymptotically safe gravity are cited as examples of approaches that aim at quantum gravity without requiring full unification with the Standard Model’s structure.

How do “extra assumptions” creep into theory-building?

If a common framework is not mathematically forced, researchers must choose among many possible mathematical structures. That choice can become guesswork guided by preference rather than derivation. The transcript points to Garrett Lisi’s E8 and Eric Weinstein’s geometric unity as cases where additional assumptions are introduced because the authors favor certain mathematical structures—raising the risk that the resulting theory won’t match reality.

What critique is made about treating the Standard Model plus gravity as final?

Many proposals assume the combined framework should work at all energies and leave no open questions—implicitly treating it as the last layer of physics. The critique is that this “final and complete” assumption may be too strong; the Standard Model plus gravity might be a step toward a deeper theory rather than the end of the hierarchy.

Why might beauty and simplicity requirements block progress?

The transcript argues that fashionable criteria like naturalness can be wrong for the universe. If the true theory is not “natural” in that sense, then imposing naturalness prevents finding the correct structure. Symmetry-based starting points face a similar issue: even if symmetries succeed in the Standard Model, it may be more accurate to ask where those symmetries come from or whether they emerge rather than being fundamental.

Why is Penrose’s gravitationally induced collapse presented as the most promising approach?

It’s framed as taking the measurement problem seriously, incorporating both gravity and quantum ideas, and avoiding claims of being a final theory. It also avoids extra assumptions such as new symmetries or supposedly natural constants. A related Penrose–Diósi model has been experimentally ruled out, but the transcript emphasizes that the ruled-out version is non-local and not generally covariant, so its failure doesn’t automatically invalidate Penrose’s original idea.

Review Questions

  1. What specific missing element in quantum theory is identified as a common flaw in many theories of everything?
  2. Why does the transcript argue that forcing a single common framework can increase ambiguity and guesswork?
  3. What reasons are given for preferring Penrose’s gravitationally induced collapse over more symmetry- or naturalness-driven approaches?

Key Points

  1. 1

    A credible theory of everything must unify all four fundamental interactions and also explain the quantum measurement process, including how detectors produce outcomes.

  2. 2

    Most proposed theories of everything omit how measurement works, even though detectors are built from Standard Model particles.

  3. 3

    Resolving the Standard Model–general relativity tension may not require one single unified mathematical framework; quantum gravity can be pursued without full unification.

  4. 4

    When a unified framework isn’t mathematically required, researchers may rely on preferred mathematical structures, turning constraints into guesswork.

  5. 5

    Many approaches assume the Standard Model plus gravity is final and complete, an assumption the transcript treats as potentially overconfident.

  6. 6

    Aesthetic constraints like naturalness and symmetry may exclude the correct theory if the universe doesn’t follow those criteria.

  7. 7

    Penrose’s gravitationally induced collapse is presented as promising because it addresses measurement, includes gravity and quantum ideas, and avoids final-theory and extra-assumption claims.

Highlights

The central failure mode is not just lack of data—it’s the absence of a quantum measurement mechanism in most unification attempts.
Forcing a single “common framework” can be unnecessary and can inject ambiguity when mathematical assumptions aren’t uniquely determined.
Penrose’s gravitationally induced collapse is favored for taking measurement seriously while avoiding claims of being the final theory.
The Penrose–Diósi model’s experimental rejection is treated as specific to a non-local, non-covariant version rather than a blanket refutation of Penrose’s idea.

Topics

Mentioned