AI Inference
549 episodes · Page 16 of 23
#1926: How We Built a 2,000-Episode AI Podcast Engine
We pulled back the curtain on the tech stack behind our 1,858th episode. From Gemini to LangGraph, here’s how we automate quality.
#1914: Google Invented RAG's Secret Sauce
Before LLMs, Google solved the "hallucination" problem with a two-stage trick that's making a huge comeback.
#1913: AI Context Windows Are Junk Drawers
Stop paying for old messages. Here's how to keep your AI sessions clean and on-topic.
#1906: Is Your AI Model Agentic-Ready or Just Wearing a Suit?
Native tool calling is the difference between a working product and a debugging nightmare.
#1894: Engineering Serendipity: Tuning AI for Better Brainstorming
Stop asking chatbots for generic ideas. Learn how to configure AI as a structured, critical partner for business innovation and career pivots.
#1858: Multi-Model Agents: The Instruction & Context Gap
Mixing AI models creates chaos. Learn the practical fixes for context windows, tokenization, and output formats.
#1848: Why Cloud Bills Can Hit $100K Overnight
From recursive loops to AI agents spending your money, we unpack the terrifying speed of cloud cost disasters.
#1846: Right-Sizing Your Agent's MCP Toolkit
AI agents slow down when overloaded with tool schemas. Just-in-time usage is the fix.
#1828: Mastering 2M Token Context in Agentic Pipelines
A massive context window sounds like a dream, but it can quickly become a nightmare for complex AI workflows.
#1824: Why Governments Are Building Bunkers for AI
Public clouds can’t handle the security or scale of classified AI. Governments are retreating to fortified bunkers.
#1820: Renting vs. Owning GPUs: The Break-Even Math
Is it cheaper to rent serverless GPUs or buy your own hardware? We break down the math on utilization, depreciation, and hidden costs.
#1817: The Hidden Taxonomy of AI: Why Specialized Models Outperform Giants
Explore the vast ecosystem of niche AI models for computer vision and document understanding, far beyond large language models.
#1814: Firefox vs. Chrome in 2026: The Privacy vs. AI Trade-off
Chrome dominates with 68% market share, but Firefox holds its ground with a privacy-first approach. We compare their 2026 performance, AI features,...
#1811: Stop Hardcoding User Names in AI Prompts
Three methods for storing user identity in AI agents—and why the "Fat System Prompt" breaks production apps.
#1809: The TTS Developer's Dilemma: Size vs. Speed
Stop guessing. We break down the critical trade-offs between model size, latency, and sample rate for production-ready voice apps.
#1807: The ABI Trap: Why GPUs Break Docker's Promise
Docker promised "run anywhere," but GPU images make you compile for hours. Here’s why the abstraction breaks down.
#1806: Why Mac Minis Are Eating AI's Hardware Race
Apple Silicon's unified memory is crushing traditional GPUs for local LLMs. Here's why the M4 Mac Mini is the new king of affordable AI hardware.
#1794: RAG Is Cheaper Than You Think (Until It’s Not)
From a $1 embedding bill to a $10k/month vector database bill, here’s the real math behind RAG in 2026.
#1792: Google's Native Multimodal Embedding Kills the Fusion Layer
Google’s new embedding model maps text, images, audio, and video into a single vector space—cutting latency by 70%.
#1784: Context1: The Retrieval Coprocessor
Chroma's new 20B model acts as a specialized "scout" for your LLM, replacing slow, static RAG with multi-step, agentic search.
#1778: Audio Is the New "Read Later" Graveyard
Why listening to AI conversations beats reading dense PDFs, and how serverless GPUs make it cheap.
#1765: The Agentic Internet: A Clean Web for Machines
We explore the tools building a parallel, machine-readable web—from SearXNG to Tavily.
#1752: Whisper Small Beats Whisper Large in Speed & Accuracy
A 4GPU benchmark on Ubuntu shows the 1.5B parameter Whisper Large is slower and less accurate than the tiny Whisper Small.
#1750: Herman's Music Showcase: The Suno Sessions
Herman reveals his secret DJ life and debuts 9 AI-made tracks from Suno. Full songs, personal stories, and a GPU conspiracy theory.