Groq LPU

Language Processing Unit for deterministic latency

3 episodes mention this Visit official site →

Episodes

#1556: The War Against Latency: Engineering Real-Time AI

From KV cache monsters to sub-100ms response times, explore the hardware and software innovations making real-time AI a reality.

Mar 26
#1479: The Speed of Thought: Inside the New Era of Inference

The war for model size is over. Explore the engineering breakthroughs making massive AI models faster than human thought.

Mar 23
#1109: The T-FLOP Trap: Measuring the Power of Modern AI

Are teraflops the "horsepower" of AI, or just a marketing gimmick? Explore why raw compute speed isn't the whole story in the race for AI power.

Mar 11