AI Inference
549 episodes · Page 21 of 23
#650: When AI Thinks Longer, Not Bigger
Explore how Gemini 3.0’s Deep Think mode shifts AI from "fast" reflexes to "deliberate" reasoning to solve complex quantum physics problems.
#633: Memory Wars: The Future of Local Agentic AI
Can your PC handle the next wave of AI agents? Herman and Corn dive into VRAM, quantization, and the future of running LLMs locally.
#628: GPT-5.2: 12 Hours of Reason and the Future of AGI
GPT-5.2 spent 12 hours reasoning to solve a novel quantum physics proof. Is this the dawn of AGI or just a very sophisticated calculator?
#608: When AI Eats the World's Memory
Why is a 32GB RAM kit now $400? Herman and Corn dive into how OpenAI is gobbling up 40% of the world's memory supply for its "Stargate" project.
#598: Audio Engineering as Prompt Engineering: Better Sound, Better AI
Can better audio quality actually make an AI smarter? Discover how audio post-production functions as a new form of prompt engineering.
#584: Will AI Brain Drain Kill the Modern University?
Can AI actually do math research? Herman and Corn dive into DeepMind’s Alithia agent and the shift toward "System 2" thinking in AI.
#484: The Silicon Sharing Economy: Inside Serverless GPUs
How do small teams run massive AI models without $50,000 chips? Corn and Herman dive into the hidden plumbing of serverless GPU providers.
#477: The Hard Trade-Offs of On-Device AI Agents
Can your phone finally think for itself? Explore the hardware and software breakthroughs bringing agentic AI to the palm of your hand.
#476: Escaping the Intermediate Plateau for Niche Languages
Stuck in intermediate purgatory? Discover how to use 2026 AI tools to bridge the immersion gap and master niche languages like Hebrew.
#433: Will AI Win the Red Queen’s Race Against Superbugs?
Explore how generative AI and "microbial dark matter" are helping us stay one step ahead in the global arms race against superbugs.
#432: The Data Bottleneck Above: AI and Laser Comms in Orbit
How do you process millions of kilometers of satellite data in real-time? Explore the future of orbital AI and laser communications.
#346: GPU Scaling: The "Go Wide or Go Tall" Dilemma
Should you use a fleet of cheap GPUs or one powerhouse? Learn the math behind serverless GPU costs, cold starts, and batching efficiency.
#332: Who’s Talking? The Tech of Speaker Identification
Herman and Corn break down the difference between speaker diarization and identification to help automate meeting transcripts.
#325: The Compute Gap: Making AI Animation Affordable
Can one person build a full TV show with AI? Explore the tech and costs behind character consistency and the future of indie animation.
#289: The Hybrid Reality of High-Security AI
How do the CIA and global banks keep AI data safe? Explore the rise of sovereign clouds, air-gapped hardware, and the future of secure compute.
#267: Decoding the Transformer: From Attention to Inference
Herman and Corn dive into the mechanics of transformer inference, exploring how models turn massive matrices into meaningful conversation.
#260: Digital Archeology: The Primitive Power of GPT-1
Revisit the 2018 model that started it all. Herman and Corn dive into GPT-1's romance-novel roots and its 117-million-parameter legacy.
#257: AI That Evolves: Solving the Preference Problem
Why do AI recommendations feel stuck in the past? Discover the technical hurdles of real-time learning and the future of personalized agents.
#250: The Crowdsourced Map That Knows Your Lane
Explore how AI, computer vision, and crowdsourced data allow navigation apps to map every painted line on the road with precision.
#210: Predictive Motion: How Transformers Are Learning to Walk
Explore how the same transformer architecture behind chatbots is now enabling robots to navigate the physical world using action tokens.
#199: When AI Outruns Physics: The New Weather Forecaster
Exploring the shift from physics-based models to AI-driven meteorology. Can algorithms predict the next big storm better than humans?
#182: The Quadratic Bottleneck: Why AI Needs New Architectures
Is the transformer’s reign ending? Herman and Corn explore Mamba, x-LSTM, and the architectures solving AI's massive memory problem.
#181: Why Your AI Is Finally Stopping to Think
Discover how AI shifted from instant reflexes to deep reflection through inference-time compute and hidden reasoning steps.
#171: From Digital Fortresses to Machine-Digestible Sites
Stop fighting the crawlers and start feeding them. Learn how llms.txt and structured metadata are defining the new era of AI Optimization.