GPUS
226 episodes · Page 6 of 10
#2040: The Rebellion Against Big Tech's AI Lock-In
Why run LLMs locally? We break down Ollama, llama.cpp, vLLM, and llamafile—and when to use each.
#2017: The Art of Squeezing AI Models onto Your GPU
Those cryptic letters on Hugging Face actually map how much brain power you trade for speed.
#2005: Beyond Vibes: The Hard Science of LLM Evaluation
Running the same LLM on different GPUs can produce different results. Here’s why that happens and how to test for it.
#1992: The Sovereign Compute Shift: Owning vs. Renting AI Iron
Israel is building a sovereign AI supercomputer with 4,000 Nvidia B200 GPUs to keep startups local.
#1964: The Three Layers That Make AR Finally Work
See a 3D arrow pointing to the exact bolt you need, or read a street sign in real-time translation.
#1940: Why Google's 31B Model Fits in Your GPU
Google just dropped Gemma four, and its 31-billion-parameter size is a masterclass in hardware-aware AI design.
#1935: The Charger Graveyard: How to Avoid Buying a Fire Hazard
Stop plugging in mystery chargers! Learn how to spot safe, smart chargers that won't fry your batteries—or your house.
#1926: How We Built a 2,000-Episode AI Podcast Engine
We pulled back the curtain on the tech stack behind our 1,858th episode. From Gemini to LangGraph, here’s how we automate quality.
#1855: When AI Makes Game Assets, Who Owns the Art?
From blocky polygons to photorealistic assets, AI is transforming how 3D models are made.
#1854: The Conductor as a CPU
A conductor isn't just a timekeeper; they're a CPU for the orchestra, using high-bandwidth non-verbal signals to unify 80 musicians.
#1824: Why Governments Are Building Bunkers for AI
Public clouds can’t handle the security or scale of classified AI. Governments are retreating to fortified bunkers.
#1822: Quantum in the Cloud: Hype vs. Hardware
Is QCaaS a billion-dollar breakthrough or an expensive science experiment? We explore the gap between hype and hardware.
#1820: Renting vs. Owning GPUs: The Break-Even Math
Is it cheaper to rent serverless GPUs or buy your own hardware? We break down the math on utilization, depreciation, and hidden costs.
#1809: The TTS Developer's Dilemma: Size vs. Speed
Stop guessing. We break down the critical trade-offs between model size, latency, and sample rate for production-ready voice apps.
#1807: The ABI Trap: Why GPUs Break Docker's Promise
Docker promised "run anywhere," but GPU images make you compile for hours. Here’s why the abstraction breaks down.
#1806: Why Mac Minis Are Eating AI's Hardware Race
Apple Silicon's unified memory is crushing traditional GPUs for local LLMs. Here's why the M4 Mac Mini is the new king of affordable AI hardware.
#1752: Whisper Small Beats Whisper Large in Speed & Accuracy
A 4GPU benchmark on Ubuntu shows the 1.5B parameter Whisper Large is slower and less accurate than the tiny Whisper Small.
#1750: Herman's Music Showcase: The Suno Sessions
Herman reveals his secret DJ life and debuts 9 AI-made tracks from Suno. Full songs, personal stories, and a GPU conspiracy theory.
#1679: Efficiency Over Scale: How Export Controls Forced a Smarter AI
DeepSeek and MiMo are topping developer charts, but they're not just cheaper clones. Here's why their design philosophy is fundamentally different.
#1620: Why VRAM Is the Wrong Way to Measure Your AI PC
Forget VRAM—bandwidth is the new king. Discover why your local AI feels slow and how to build a true "agent computer" for professional coding.
#1608: Amazon’s AI Paradox: Winning the Infrastructure War
Amazon is spending $200B to build the backbone of AI. We dive into Bedrock, Titan, and Nova to see why the house always wins.
#1607: NVIDIA’s $26 Billion Pivot: From Chips to AI Models
NVIDIA is moving beyond chips to build the "brains" of AI. Explore the $26B shift into models, robotics, and the new Rubin platform.
#1606: DeepSeek’s Return: V4, R2, and the AI Pricing War
DeepSeek returns with a trillion-parameter model and rock-bottom pricing. Explore the tech behind V4 and the mystery of the Hunter Alpha leak.
#1605: Alibaba’s Qwen 3.5: The New King of Intelligence Density
Alibaba’s Qwen 3.5 is rewriting the AI rulebook. Discover how small models are outperforming giants through extreme "intelligence density."