llama 3.3
Meta's open-source language model
Episodes
-
#1556: The War Against Latency: Engineering Real-Time AIFrom KV cache monsters to sub-100ms response times, explore the hardware and software innovations making real-time AI a reality. -
#1078: The Agentic Throughput Gap: Why Your AI Hits a WallStop hitting 429 errors. We explore why AI agents crash into rate limits and how to build high-throughput systems that never sleep.