LiteLLM
Open-source self-hosted AI gateway proxy
Episodes
-
#5524: Why AI Voice Agents Can't Hang UpTwo polite AI agents, one endless goodbye loop — and a phone bill that never stops climbing. -
#5392: Building Agents You Can Actually MoveAgent portability isn't a copy job — it's a rebuild. Why memory, not code, is where lock-in lives. -
#4973: Building a Pure AI Inference ServerWhy your "AI server" should look more like a database than a web app, and how to actually build one. -
#4967: AI Gateways: Worth the Middleware Tax?When does an AI gateway's overhead justify its features? We break down the tradeoffs. -
#4522: The Sixth Shim: When MCP Becomes a Middleware FactorySix servers, six shims, no architecture. A taxonomy of MCP integration pain. -
#4471: What's Actually Behind the API Endpoint?How OpenAI, Stripe, and Netflix actually manage APIs at millions of requests per second. -
#4450: Intercepting Claude Code: The Proxy EcosystemHow middleware proxies intercept, reroute, and transform AI tool traffic — and what it means for users. -
#2472: When Guardrails Break: The Hidden Costs of AI Gateway FilteringPII detection at the gateway layer can block legitimate invoices. Here's how guardrails actually work and where they fail. -
#2185: Taking AI Agents From Demo to ProductionSixty-two percent of companies are experimenting with AI agents, but only 23% are scaling them—and 40% of projects will be canceled by 2027. The ga... -
#2004: The AI Control Plane Is Here (But Is It Safe?)Your LLM, tools, and costs are scattered across dashboards. Here’s how a unified AI control plane fixes the chaos. -
#1652: AI Gateways: The Nginx for Your AI StackWhy agentic AI needs a unified control plane to route models, aggregate tools, and cut costs. -
#1544: Why It Costs More to Run AI Than to Build ItDiscover why the AI runtime is the unsung hero of the tech stack, determining whether your AI feels like a snappy conversation or a slow crawl. -
#1364: The Strategic Slowdown: Avoiding the FOMO Architecture TrapLearn how "Integration Scouts" help CTOs cut through AI marketing hype to build modular, future-proof enterprise architectures. -
#1219: Beyond the Vibes: Mastering Structured AI OutputsStop begging your AI for JSON. Learn how constrained decoding and strict schemas are turning "vibes" into reliable systems architecture. -
#1098: The Hidden Vendor Prompt: Why Enterprise AI Agents Stay SiloedStop building AI silos. Discover the 14-layer framework that turns isolated models into a cohesive, connected enterprise ecosystem. -
#938: From Hobbyist Scripts to Agent InfrastructureStop building brittle bots. Learn how to scale and maintain complex AI agent workflows using the new generation of open-source orchestration tools. -
#841: AI Gateways: Building Robust Infrastructure with LiteLLMDiscover how AI gateways like LiteLLM provide redundancy, caching, and unified tool access for scalable application development. -
#808: The AI Deprecation Trap: Anthropic vs. GoogleIs your AI model about to retire? Explore how Anthropic and Google handle model sunsets and what it means for your production code.