NVIDIA H100
High-end GPU for AI training
Episodes
-
#5041: GPT-6 Astra, 100K GPUs, and the AGI QuestionOpenAI's GPT-6 Astra arrives with an AGI claim and a 100K-GPU training run. We break down what Stargate LLC actually is and whether the scale justi... -
#2782: Are AI Data Centers Really New or Just Patched Together?The real bottleneck isn't GPUs — it's power transformers. A look at the physics and economics of AI infrastructure. -
#2568: When Does Your House Need Three-Phase Power?Why industrial machines need different electricity — and when your home AI rig might too. -
#2431: The 3 Markets in an AI Trench CoatGPUs, LPUs, and ASICs: why the best hardware for AI depends entirely on what you're trying to do. -
#2115: Why AI Answers Differ Even When You Ask TwiceYou ask an AI the same question twice and get two different answers. It’s not a bug—it’s physics. -
#2067: MoE vs. Dense: The VRAM NightmareMoE models promise giant brains on a budget, but why are engineers fleeing back to dense transformers? The answer is memory. -
#2063: That $500M Chatbot Is Just a Base ModelThat polite chatbot? It started as a raw, chaotic autocomplete engine costing half a billion dollars to build. -
#2021: Your Frozen AI Is Getting Smarter (Here's How)Your AI model might be static, but the system around it can make it learn in real-time. -
#2005: Beyond Vibes: The Hard Science of LLM EvaluationRunning the same LLM on different GPUs can produce different results. Here’s why that happens and how to test for it. -
#1907: Why We Still Fine-Tune in 2026Despite million-token context windows, fine-tuning remains essential. Here’s why behavior, not just facts, matters. -
#1824: Why Governments Are Building Bunkers for AIPublic clouds can’t handle the security or scale of classified AI. Governments are retreating to fortified bunkers. -
#1820: Renting vs. Owning GPUs: The Break-Even MathIs it cheaper to rent serverless GPUs or buy your own hardware? We break down the math on utilization, depreciation, and hidden costs. -
#1778: Audio Is the New "Read Later" GraveyardWhy listening to AI conversations beats reading dense PDFs, and how serverless GPUs make it cheap. -
#1636: The Mosh Pit Model: Can Chaos Train a Better Storyteller?Can Elon Musk’s newest AI model handle a time-traveling toaster, or is it just a glorified search bar with an attitude? -
#1501: The AI Long Tail: How Small Models Outsmart the GiantsDiscover why 31B models are outperforming GPT-5.4 in reasoning and how the AI "long tail" provides the key to local sovereignty and accuracy. -
#1094: The CPU-First Era: Why AI is Moving Back to the ProcessorIs the GPU's reign over? Discover how modern CPUs and clever optimization are bringing powerful AI models to the hardware you already own. -
#992: Beyond the Digital Sandwich: The Future of Voice AIIs speech recognition dead? Explore how multimodal models are replacing the "digital sandwich" with true intent-based reasoning. -
#771: Beyond Backups: The High Stakes of Critical RedundancyHow do hospitals and data centers stay online during a disaster? Explore the engineering of "five nines" and the limits of redundancy. -
#484: The Silicon Sharing Economy: Inside Serverless GPUsHow do small teams run massive AI models without $50,000 chips? Corn and Herman dive into the hidden plumbing of serverless GPU providers. -
#346: GPU Scaling: The "Go Wide or Go Tall" DilemmaShould you use a fleet of cheap GPUs or one powerhouse? Learn the math behind serverless GPU costs, cold starts, and batching efficiency. -
#325: The Compute Gap: Making AI Animation AffordableCan one person build a full TV show with AI? Explore the tech and costs behind character consistency and the future of indie animation. -
#120: Silencing the Siren: Real-Time AI Noise ReductionHow do phones remove sirens and crying babies in real time? Explore the neural networks and hardware making crystal-clear audio possible. -
#84: The Silicon Arms Race: Why GPUs are the New OilAre high-end microchips the new enriched uranium? Herman and Corn dive into the high-stakes world of GPU export bans and global AI supremacy. -
#82: The Accidental AI EngineFrom video game dragons to digital brains: Herman and Corn explain why your graphics card is the secret engine behind the AI boom. -
#56: The Thought Experiment Nobody RunsBuilding an AI model from scratch? It's a brutal reality of trillions of tokens and millions in GPUs. Discover the hidden costs of modern AI. -
#18: Beyond the GPU: Unpacking AI's Chip RevolutionBeyond the GPU: we're unpacking AI's chip revolution. Discover the crucial, often overlooked world of AI's fundamental building blocks.