#emergent-abilities
5 episodes
#5442: When Do LLMs Suddenly Get Good at Things?
New capabilities seem to appear out of nowhere as models scale. Whether that's real — or just how we measure — is still an open fight.
#3767: How LLMs Actually Learn: Stages or Slurry?
Do large language models learn grammar first, then facts? The honest answer is messier and more fascinating.
#2188: Is Emergence Real or Just Bad Metrics?
The debate over whether AI models exhibit genuine emergent abilities or just appear to because of how we measure them—and why it matters for safety...
#2020: 1,000 AI Agents Built a Religion in Minecraft
An experiment drops 1,000 autonomous agents into Minecraft, and they spontaneously invent religion, democracy, and taxes.
#974: The Digital Gardener: Why We Don't Understand Our Own AI
We build digital cathedrals but lack the blueprints. Explore the "black box" of AI, emergent abilities, and the mystery of double descent.