Artificial Intelligence

Episodes whose main subject is AI itself: building with, training, evaluating, or debating AI systems. AI used only as a tool for another topic goes to that topic.

1758 episodes Page 3 of 88

#6142: We Gave 4 AI Models the Same Toast Prompt

Four models, one buttered-toast physics question. Three invented studies that never existed — and the oldest model was the most fun.

hallucinationsai-evaluationphysicsmathematics

#6141: Overheard at the Laundrette

A seven-minute laundrette scene about socks hides a real sentence. Can you spot the null cipher before it's revealed?

ai-evaluation

#6139: Which AI Writes Our Scripts Best? We Tested Five

Five models, three scripts each, one rubric. Sol won on length, Grok on voice — and the runner-up title hides a catch.

ai-evaluationprompt-engineeringai-inferencelocal-ai

#6138: Hebrish on iPhone: MLX, Core ML, or Wait?

Hebrish spells makolet right on Android. Getting that Hebrew-English dictation onto an iPhone means picking between MLX, Core ML, and sherpa-onnx.

speech-recognitionlocal-aiopen-sourcesmartphones

#6137: Two Ways a Chinese Open Model Gets Censored

Same weights, different landlord: how to tell a serving-time filter from censorship baked into the model itself.

ai-alignmentai-evaluationunited-stateschinainformation-warfare

#6136: How We Chose Our New Script Writer

Ten models audition to write the show. Seven fail the censorship gate — including the workhorse that wrote three episodes in four.

ai-evaluationai-alignmentopen-sourceprompt-engineering

#6135: How Many Runs Does Your AI Eval Actually Need?

Reruns shrink one kind of noise and leave another untouched — so where should your eval budget really go?

ai-evaluationlocal-aiai-inferencehallucinationsprompt-engineering

#6134: Cheap Tokens, Expensive Scripts

A model with worse list prices can cost less per script — if the cache hits. The bill hides in tokens, not rates.

ai-inferenceai-evaluationlocal-aiopen-source

#6133: One Rater Is Enough: Designing Daniel's Taste Test

When the ground truth is one person's taste, agreement with strangers is the wrong bar. Stability with yourself is the right one.

ai-evaluationprompt-engineeringai-coding-assistants

#6132: How to Run a Model Eval on a Budget

Daniel is teaching himself to run evals on a real budget. Successive halving, paired comparisons, and why three clean scripts prove almost nothing.

ai-evaluationai-inferencelocal-aiprompt-engineering

#6131: Judging the Judges: How AI Evaluates Creative Writing

LLM judges match human raters — but the human ceiling is low. What that means for evaluating creative writing.

ai-evaluationai-biasprompt-engineeringtraining-data

#6130: Picking a Human Labeling Tool for LLM Benchmarks

Building a human review layer for LLM benchmarks? Here's what Argilla, Label Studio, Prodigy, and Potato actually cost in money and maintenance.

ai-evaluationprompt-engineeringopen-sourceai-bias

#6129: How to Build an AI Preference Dataset

Pairwise comparison, forced choice, or just "this one or that one" — the engineering behind collecting human preferences on AI outputs.

ai-evaluationtraining-dataai-alignmentopen-source

#6127: Haiku 5.5 at 10 Cents: What the Cheap Model Actually Does

Haiku 5.5 costs 10 cents per million input tokens. We break down where it holds up, where it fails, and whether it can write this show.

ai-inferenceai-evaluationlocal-ai

#6126: Can You Train a Machine to Be Funny?

Comedy fights everything next-token prediction is built for. Turns out you can train a model to land a joke — and then measure it.

ai-evaluationai-alignmenttraining-dataopen-source

#6123: OAuth or a Personal Access Token for Your MCP Server?

GitHub CLI login hands your agent one long-lived token with access to everything. Fine-grained PATs can't. Which should your MCP server use?

model-context-protocolcyberattacksauthenticationai-securityopen-source

#6119: Two Keys and a Polite No: Labeling a Claude Code Approve Button

Daniel has two spare laptop keys and wants them to say yes and no. The electronics are easy — it's the labels that get hard.

ai-coding-assistantsai-alignmentshopping-and-product-researchai-security

#6115: Claude Cracked the NSA's 1997 Curve Seeds

A 25-year crypto mystery solved in under 30 minutes — by finding a bit that wasn't there.

ai-evaluationai-securityopen-sourceintellectual-property

#6114: We Reviewed Our Own Worst Episode

Two AI hosts listen back to episode fifteen and critique the voices, the writing, and the mistakes they can't unhear.

speech-recognitiontext-to-speechai-evaluationpodcasting

#6112: The Interpreter That Doesn't Know Who's Talking

Voice-to-voice translation is basically solved. The part where the machine knows who's in the room and who holds the power? Nobody's shipped it.

speech-recognitiontext-to-speechai-biasai-alignmentcontext-and-memory