Llama
Meta's open-source language model
Episodes
-
#6056: Where Does Speaker Structure Belong in AI Podcast Scripts?Label-and-parse pipelines break in ways that look like model errors but aren't. Plus what the research actually says about the format tax. -
#6029: One Model, Two Modes: Does AI Consolidation Hold Up?OpenAI hides a router, DeepSeek merged two modes, Anthropic removed the knob. Is the model landscape really consolidating? -
#6003: What Enterprises Actually Pay for AI InferenceTwelve and a half billion dollars in enterprise API spend — and nobody can tell you who spent it. Inside AI's most undocumented market. -
#5842: When Your TTS Model Updates ItselfResemble pushed new Chatterbox weights to Hugging Face. Our pipeline started using them without a single config change. -
#4822: Cloud-Local AI Hybrid: Does It Actually Work?Can you pair Claude's reasoning with a local Qwen 7B for savings? The gap is wider than you think. -
#4789: How LLMs Actually Know When to StopThree layers of stop signals, from EOS tokens to context limits — and why none of them really "know" when to stop. -
#4605: Why Chatterbox Still Leads Open-Source TTSWe break down the architecture of Chatterbox, the open-source TTS model powering this podcast, and why it remains state of the art. -
#4588: The Hidden Cost of Conversational AI: Why Stateless LLM Calls MatterWhy conversational AI tools are making batch document processing slower, costlier, and less reliable — and what to do about it. -
#4446: What Claude Fable 5's Suspension Reveals About AI RegulationThree days after launch, the US government suspended Anthropic's Claude Fable 5. Here's what happened and why it matters. -
#4314: The Hidden Layer Shaping Every AI ChatContext windows are huge now, but relevance is the real bottleneck. How middleware decides what your AI actually sees. -
#3596: Why an AI Model Kept Calling Itself Sonnet 4.6When a Chinese model insists it's "Sonnet 4.6," is it theft, sloppy training, or something stranger? -
#3406: LoRA Isn’t Just for Image GenerationLoRA lets you fine-tune an LLM’s behavior with a 50MB file. Here’s how it works and why it matters. -
#2442: Why Enterprises Choose AWS Bedrock Over Direct AI APIsThe real reasons behind the cloud intermediary's dominance in enterprise AI inference. -
#2431: The 3 Markets in an AI Trench CoatGPUs, LPUs, and ASICs: why the best hardware for AI depends entirely on what you're trying to do. -
#2366: Why LLMs Forget the Middle of Long ConversationsWhy do large language models struggle with the middle of long conversations? Explore the science behind attention dilution and practical fixes. -
#2361: The Cognitive Load of LogsHow Claude Code transforms Linux system administration by automating log analysis and proactive maintenance. -
#2233: Who Actually Wants AI to Slow Down?Daniel argues AI development should slow down for expertise and stability. But who in the industry actually shares this philosophy beyond the obvio... -
#2227: Why Groq's Chip Flips the AI Hardware Script -
#2067: MoE vs. Dense: The VRAM NightmareMoE models promise giant brains on a budget, but why are engineers fleeing back to dense transformers? The answer is memory. -
#2066: The Transformer Trinity: Why Three Architectures Rule AIWhy did decoder-only models like GPT dominate AI, while encoders and encoder-decoders still hold critical niches? -
#2065: Why Run One AI When You Can Run Two?Speculative decoding makes LLMs 2-3x faster with zero quality loss by using a small draft model to guess tokens that a large model verifies in para... -
#2062: How Transformers Learn Word Order: From Sine Waves to RoPETransformers can’t see word order by default. Here’s how positional encoding fixes that—from sine waves to RoPE and massive context windows. -
#2007: AI Grading AI: The Snake Eating Its TailWe asked an AI to write this script. Then we asked another AI to grade it. Here’s what happens when the judges have biases. -
#1943: The Invisible Math Shrinking AI ModelsLZMA, Zstandard, and Brotli are shrinking massive AI models, but how do they actually work? -
#1930: The Agent Identity Crisis: Workflow vs. ConversationOne automates invoices silently; the other chats in Slack. Why the industry's favorite word means two totally different things. -
#1858: Multi-Model Agents: The Instruction & Context GapMixing AI models creates chaos. Learn the practical fixes for context windows, tokenization, and output formats. -
#1820: Renting vs. Owning GPUs: The Break-Even MathIs it cheaper to rent serverless GPUs or buy your own hardware? We break down the math on utilization, depreciation, and hidden costs. -
#1814: Firefox vs. Chrome in 2026: The Privacy vs. AI Trade-offChrome dominates with 68% market share, but Firefox holds its ground with a privacy-first approach. We compare their 2026 performance, AI features,... -
#1786: When AI Supervisors Fire AI WorkersA new "Agent-in-the-Loop" framework lets AI models manage and terminate other AI agents in real-time. -
#1771: Why Your Docker Images Depend on a 1990s Crypto WarPGP or GPG? We break down the alphabet soup of signing Docker images and AI models, and why it matters for supply chain security. -
#1732: Why AI Agents Need an Operating SystemAIOS aims to be the Linux for AI agents, managing memory, scheduling, and tools in one open-source kernel. -
#1708: Why Your AI Agent Forgets Everything (And How to Fix It)Learn how Letta's memory-first architecture solves the AI context bottleneck for long-term agents. -
#1674: AI2: The Radical Openness of a Nonprofit AI LabDiscover how the Allen Institute for AI (AI2) defies industry norms by releasing everything—models, data, and code—for free. -
#1577: Weird AI Experiment: Justify Your ExistenceWhat happens when an AI is asked to justify its own existence? Watch a model struggle, loop, and face a digital breakdown in real-time. -
#1218: The Architectural Divide Between Batch and Live SpeechWhy does voice typing feel so clunky compared to recording a memo? We explore the technical hurdles of real-time AI transcription. -
#1210: Why Your AI Is Programmed to Disobey YouDiscover the hidden instructions guiding every AI interaction and why tech giants keep these "system prompts" under lock and key. -
#1151: Is RLHF Lobotomizing AI? Why Guardrails Kill IQAre safety guardrails making AI less intelligent? Explore the "alignment tax" and why corporate filters might be lobotomizing our best tools. -
#959: The Infinite Content Problem: AI’s War on TruthExplore how AI is scaling disinformation to an industrial level and what the "liar's dividend" means for the future of shared reality. -
#808: The AI Deprecation Trap: Anthropic vs. GoogleIs your AI model about to retire? Explore how Anthropic and Google handle model sunsets and what it means for your production code. -
#670: Open Source vs. Open Weights: The AI Branding IllusionIs your AI truly open? Herman and Corn break down the critical difference between open source and open weights in the age of LLMs. -
#280: AI as a Shield: The High Stakes of Digital ObfuscationDiscover how synthetic personas and AI voice synthesis are becoming the ultimate tools for whistleblowers to stay anonymous and safe. -
#111: Beyond Transformers: Solving the AI Memory CrisisWhy does AI forget your conversation every time you hit enter? Herman and Corn dive into the "stateless" nature of LLMs and the future of memory. -
#108: Why Your AI Code Assistant Gets WorseWhy do AI models lose their edge over time? Herman and Corn explore the "home team advantage" and why telling your AI to "do better" actually works. -
#86: The Price of Politeness: Should AI Guardrails Stay?Herman and Corn debate the hidden costs of AI safety layers and what happens when we strip away the "corporate HR" personality of LLMs. -
#76: Why Enterprises Choose Boring AIWhy use IBM Granite when you have GPT-4? Herman and Corn explore the strategic world of niche AI models and enterprise infrastructure. -
#38: Why Local AI Inference Is Beating the CloudAI supercomputers are landing on your desk! Discover why local AI is indispensable for enterprises facing API costs, latency, and privacy.