AI Inference
549 episodes · Page 20 of 23
#1081: The K-V Cache: Solving AI’s Invisible Memory Tax
Why does your AI get slower as you chat? Discover the K-V cache, the invisible bottleneck of generative AI, and how we're fixing it in 2026.
#1078: The Agentic Throughput Gap: Why Your AI Hits a Wall
Stop hitting 429 errors. We explore why AI agents crash into rate limits and how to build high-throughput systems that never sleep.
#1077: Will Your Browser Replace Your OS for Local AI?
See how Web GPU and Web NN are turning your browser into a local AI engine, ending the era of complex DIY setups and protecting your privacy.
#1066: Beyond the Blank Slate: The Evolution of AI Training
Explore the "weight surgery" techniques labs use to expand AI models without losing their core knowledge or starting from zero.
#1061: Why a Brain Cell Beats a Microchip
Can a petri dish play Pong? Discover how "wetware" is using living brain cells to redefine the future of energy-efficient computing.
#1021: The Python Paradox: Why AI's Backbone Is a Nightmare to Deploy
Why did a 1980s hobby project become the backbone of AI? Explore the history of Python and the chaos of modern dependency management.
#992: Beyond the Digital Sandwich: The Future of Voice AI
Is speech recognition dead? Explore how multimodal models are replacing the "digital sandwich" with true intent-based reasoning.
#874: From Vibes to Engineering: Mastering JSON Schema for AI
Stop begging your AI for clean data. Learn how JSON schema turns unreliable LLM responses into strict, predictable software components.
#869: Why Tiny Digital Savants Are Outperforming God-Models
Are massive AI models hitting a wall? Discover why the future belongs to lean, domain-specific "digital savants" and vertical pre-training.
#864: The Death of SaaS: Building Your Own Bespoke AI Tools
Stop paying for dozens of subscriptions. Learn how AI agents are allowing anyone to build custom, private software tailored to their exact needs.
#857: The Cognitive Cost of Capitalization
Can local AI fix your messy typing in real-time? Explore the tech behind "transparent buffers" that turn sloppy drafts into polished prose.
#853: The Mid-Range Camera Awakening
Discover why megapixels aren't everything and how sensor size, aperture, and periscope lenses are redefining pro mobile photography in 2026.
#846: Beyond the Vector: Building Long-Standing AI Memory
Stop relying on basic vector search. Discover how Graph RAG and RAPTOR are creating AI systems with true long-standing memory.
#841: AI Gateways: Building Robust Infrastructure with LiteLLM
Discover how AI gateways like LiteLLM provide redundancy, caching, and unified tool access for scalable application development.
#808: The AI Deprecation Trap: Anthropic vs. Google
Is your AI model about to retire? Explore how Anthropic and Google handle model sunsets and what it means for your production code.
#791: The Roller Coaster of Tech Adoption
Is the AI magic wearing off? We dive into the Gartner Hype Cycle to see where LLMs and autonomous agents actually stand in 2026.
#769: When Manuals Learn to See in 3D
Discover how AI and spatial computing are turning complex hardware repairs into real-time, interactive experiences.
#755: From Duct Tape to Autonomous Studio: Scaling a 741-Episode AI Podcast
Peek under the hood of My Weird Prompts to see how Gemini, Modal, and multi-agent systems are scaling this automated show to the next level.
#753: Beyond SEO: The Guide to Agentic Behavior Optimization
Move beyond search engines and learn how to make your website the primary source for the next generation of AI agents.
#752: Will AI Kill the Click? Why Search Is Becoming Invisible
Stop shouting nouns at a screen. Discover how AI is turning the "ten blue links" into a conversational assistant that understands your intent.
#727: The Math of Immersion: How 360-Degree Sound Actually Works
Learn how object-based audio and clever math trick your brain into hearing 360-degree sound from even the smallest mobile devices.
#671: Keys to the Kingdom: Securing AI Model Weights
How do AI labs share their models without losing the secret sauce? Explore the tech keeping Claude secure in the Pentagon’s hands.
#666: Why It Costs More to Talk to AI in Your Native Tongue
Is AI truly universal, or are we trapped in an English-speaking bubble? Discover how the "tokenization tax" impacts global AI equity.
#663: The Three Pillars of Workstation Performance
Is a high-end desktop enough, or do you need a workstation? Herman and Corn break down the "three pillars" of professional hardware.