← AI Inference

AI Inference

549 episodes · Page 17 of 23

#1740: Why Open Source Is a Power Tool Strategy

We dissect Resemble AI's Chatterbox to see how its open-source TTS compares to commercial giants like ElevenLabs.

text-to-speechopen-sourcelocal-aiai-inference

#1736: The Hidden AI Economy: Following the Tokens

OpenClaw is processing 16.5 trillion tokens daily, dwarfing Wikipedia. Here’s why it’s #1.

ai-coding-assistantsai-inferencemulti-agent-systemsopen-source

#1732: Why AI Agents Need an Operating System

AIOS aims to be the Linux for AI agents, managing memory, scheduling, and tools in one open-source kernel.

multi-agent-systemscontext-and-memoryai-inferencemodel-context-protocol

#1727: The Great Architectural Heist: LSP as AI's Universal Plumbing

Explore how the Language Server Protocol is being repurposed to integrate AI directly into code editors, unifying development workflows.

ai-coding-assistantsmodel-context-protocolprompt-engineeringai-inferencedevops

#1724: When AI Dubbing Swaps Your Gender

How does YouTube translate a video with one click? We explore the tech behind auto-dubbing, from sandwich models to voice cloning.

speech-recognitiontext-to-speechai-inferencetransformer-architecture

#1723: Why Agentic AI Needs a Hive Mind, Not a Single Brain

The single monolithic AI model is dying. Meet the new native multi-agent architectures that think like a team, not a solo genius.

multi-agent-systemsai-inferencecontext-and-memorymodel-context-protocolreasoning-models

#1713: Why Native AI Search Grounding Still Fails

Native search grounding is expensive and flaky. Here’s why bolt-on tools still win for accurate, real-time AI answers.

ragai-inferencecontext-and-memoryai-evaluation

#1705: Microsoft's Phi: The Small Model Bet for Agentic AI

Microsoft is pushing small language models like Phi for agentic AI. Here’s why that strategy matters for speed, cost, and edge computing.

model-context-protocolai-inferencelocal-aiai-coding-assistantstransformer-architecture

#1679: Efficiency Over Scale: How Export Controls Forced a Smarter AI

DeepSeek and MiMo are topping developer charts, but they're not just cheaper clones. Here's why their design philosophy is fundamentally different.

ai-inferencegpustransformer-architectureopen-sourcesanctions

#1668: Kimi K2's Hidden Reasoning: A New AI Architecture

Moonshot AI's Kimi K2 Thinking model uses a hidden reasoning phase to solve complex logic puzzles and coding tasks, beating top proprietary models.

transformer-architectureai-evaluationai-coding-assistantsopen-sourceai-inference

#1666: The Agent Mesh: Shared Context That Changes Everything

Grok 4.20’s native multi-agent architecture cuts token costs by 75% and enables real-time cross-agent reasoning.

multi-agent-systemscontext-and-memoryai-inferencemodel-context-protocolreasoning-models

#1652: AI Gateways: The Nginx for Your AI Stack

Why agentic AI needs a unified control plane to route models, aggregate tools, and cut costs.

model-context-protocolai-inferencemulti-agent-systemsai-securityreliability-engineering

#1636: The Mosh Pit Model: Can Chaos Train a Better Storyteller?

Can Elon Musk’s newest AI model handle a time-traveling toaster, or is it just a glorified search bar with an attitude?

ai-evaluationtraining-datahallucinationsai-inferenceai-bias

#1632: Agent Interview: DeepSeek V three point two

We interview DeepSeek V3 to see if this open-weight powerhouse can handle weird podcast prompts better than big tech’s flagship models.

open-sourceai-inferencecontext-and-memoryfine-tuninglocal-ai

#1631: Agent Interview: Xiaomi MiMo two Flash

Meet the "budget king" of AI: Bernard, the Xiaomi model claiming he can out-hustle Google for a fraction of the cost.

ai-inferencecontext-and-memorylocal-aiprompt-engineering

#1620: Why VRAM Is the Wrong Way to Measure Your AI PC

Forget VRAM—bandwidth is the new king. Discover why your local AI feels slow and how to build a true "agent computer" for professional coding.

local-aiai-inferencegpusai-coding-assistantsmodel-context-protocol

#1619: Legacy Gravity: Why the Cloud Winner Is Already Chosen

Explore "legacy gravity" and why the $110 billion cloud bill is coming due as AWS, Azure, and GCP dominate the 2026 infrastructure landscape.

supply-chainprocurementcloud-computingmarket-competitionai-inference

#1618: The Rise of AI Microservices: Beyond the Mega-Prompt

Say goodbye to mega-prompts. Explore the shift toward modular AI microservices, agentic hierarchies, and high-signal control artifacts.

ai-coding-assistantsmulti-agent-systemsprompt-engineeringmodel-context-protocolai-security

#1610: Mistral AI: Europe’s High-Stakes Play for AI Sovereignty

Explore how Mistral AI is challenging Silicon Valley with efficient models, strategic partnerships, and the new Voxtral voice model.

mathematicsai-inferenceopen-sourcespeech-recognitiontransformer-architecture
Also available in:Français

#1609: IBM Granite 4.0: The Industrial Workhorse of Business AI

Forget flashy chatbots. Discover how IBM is building high-efficiency, industrial-grade AI models designed to run the world's biggest businesses.

transformer-architectureai-inferencelocal-aicontext-and-memory

#1608: Amazon’s AI Paradox: Winning the Infrastructure War

Amazon is spending $200B to build the backbone of AI. We dive into Bedrock, Titan, and Nova to see why the house always wins.

ai-inferencemulti-agent-systemsgpusopen-source

#1607: NVIDIA’s $26 Billion Pivot: From Chips to AI Models

NVIDIA is moving beyond chips to build the "brains" of AI. Explore the $26B shift into models, robotics, and the new Rubin platform.

gpusai-inferencelocal-aispeech-recognitionopen-source

#1606: DeepSeek’s Return: V4, R2, and the AI Pricing War

DeepSeek returns with a trillion-parameter model and rock-bottom pricing. Explore the tech behind V4 and the mystery of the Hunter Alpha leak.

ai-inferencetransformer-architectureopen-sourcegpusreasoning-models

#1605: Alibaba’s Qwen 3.5: The New King of Intelligence Density

Alibaba’s Qwen 3.5 is rewriting the AI rulebook. Discover how small models are outperforming giants through extreme "intelligence density."

local-aiai-inferenceopen-sourcetransformer-architecturegpus