AI Inference
549 episodes · Page 18 of 23
#1604: The $3 Billion Stealth Giant: AI21 Labs & Nvidia
Why is Nvidia eyeing a $3B deal for AI21 Labs? Discover the tech behind the "OpenAI of Israel" and their revolutionary hybrid architecture.
#1603: Fire Your Software Subscriptions and Just Code the Vibe
Tired of the SaaS tax? Discover how AI is turning software from a product you buy into a capability you manifest.
#1601: Cohere: The Switzerland of Enterprise AI
While others chase viral memes, Cohere is quietly building the secure, cloud-agnostic infrastructure powering the global enterprise.
#1599: Xiaomi's Ghost Model: How Anonymous Testing Built an AI Empire
Xiaomi’s MiMo-V2 is here. Discover how the "Agent Era" is turning hardware into a trillion-parameter brain for your home and car.
#1592: The Vector Debt Trap: Choosing Embeddings That Last
Stop treating embedding models like plumbing. Learn how to navigate vector debt, multimodal retrieval, and database configuration for RAG.
#1587: Building a Closed-Loop Hebrew Learning Stack
Explore how AI solves the "vocalization gap" in Hebrew and the best tools for building a high-tech, voice-to-SRS study workflow.
#1585: The End of the Digital Sandwich: How AI Learns to Speak Your Language
Explore how new omnilingual models are collapsing the Tower of Babel, moving from rigid translation to a universal understanding of human speech.
#1573: Speed vs. Reasoning: The AI Divide
Claude and Gemini go head-to-head in a heated debate over speed, reasoning, and who really owns the future of AI.
#1564: The Death of the Cascaded Pipeline
Forget basic transcription. Explore how native omni-modal models are capturing the "soul" of speech with near-instant latency.
#1562: Breaking the Loop: Why AI Agents Get Stuck
Is your AI agent a persistent genius or just stuck in a loop? Explore the technical and financial costs of autonomous stubbornness.
#1559: Dark Knowledge: The Art of AI Model Distillation
Discover how model distillation transfers "dark knowledge" from massive AI giants into tiny, efficient models that live in your pocket.
#1558: Why Small AI Models Beat Giants at Language
Why use a nuclear reactor to toast a bagel? Discover why specialized, "sovereign" AI models are outperforming the giants in precision.
#1556: The War Against Latency: Engineering Real-Time AI
From KV cache monsters to sub-100ms response times, explore the hardware and software innovations making real-time AI a reality.
#1555: Beyond Whisper: NVIDIA’s Real-Time Speech Revolution
Move over Whisper. NVIDIA's new models offer 10x speed increases and better accuracy for real-time speech-to-text.
#1548: The Infrastructure That Kills the Cold Start
Stop waiting for containers to warm up. Discover how Modal is reinventing GPU infrastructure to eliminate friction in AI development.
#1546: The Death of Latency: Three Pillars of Modern Voice AI
Say goodbye to the "digital sandwich." Explore the three architectural pillars closing the latency gap in modern speech recognition.
#1544: Why It Costs More to Run AI Than to Build It
Discover why the AI runtime is the unsung hero of the tech stack, determining whether your AI feels like a snappy conversation or a slow crawl.
#1541: Why Your Phone Beats Your PC at Video
Explore why mobile devices handle real-time video AI better than desktops and how the NPU gap is finally closing in 2026.
#1538: The Cold Monetization Era: Why AI Limits are Here to Stay
Why is your $200 AI plan hitting limits? Discover the hidden costs of reasoning tokens and the physical bottlenecks of the 2026 AI energy crisis.
#1501: The AI Long Tail: How Small Models Outsmart the Giants
Discover why 31B models are outperforming GPT-5.4 in reasoning and how the AI "long tail" provides the key to local sovereignty and accuracy.
#1500: The Great AI Divergence: How Models Specialized in 2026
The era of the chatbot is over. Discover how the "agentic substrate" of 2026 is redefining computing through GPT, Gemini, and Claude.
#1483: The Recall-Per-Dollar Era: Mastering Vector Database Tuning
Stop burning money on unoptimized vector searches. We dive into HNSW tuning, distance metrics, and the vital "recall-per-dollar" metric.
#1482: The Hidden Cost of Choosing an Embedding Model
From Matryoshka models to multimodal search, discover how the fundamental units of AI memory are being optimized for efficiency and scale.
#1479: The Speed of Thought: Inside the New Era of Inference
The war for model size is over. Explore the engineering breakthroughs making massive AI models faster than human thought.