GPQA
Graduate-level reasoning benchmark
Episodes
-
#5946: Inside Humanity's Last Exam: 2,500 Questions AI Can't Ace2,500 questions, ~1,000 experts, and a top score that jumped from 2.7% to 54.8% in 18 months. What is HLE actually measuring? -
#5056: How AI Writes a 30-Minute Podcast in One PassWhat does it take for a model to write a full episode without edits? The answer involves context windows, repetition, and a surprising architecture... -
#3157: Opus 4.8: What Actually Changed Under the HoodAnthropic dropped Opus 4.8 with no fanfare. New training data, faster inference, and smarter refusals — here's what changed.