← AI Inference

AI Inference

549 episodes · Page 19 of 23

#1473: Is Your AI Thinking or Just Faking It?

Is "think step by step" dead? Discover how test-time compute and native reasoning are replacing manual prompting in the latest AI models.

prompt-engineeringai-inferencetransformer-architectureai-evaluationreasoning-models

#1471: The Cursor Incident: Why Chinese AI Models are Winning

The Cursor leak revealed a shocking truth: Western AI dominance is fading. Discover the Chinese labs rewriting the rules of code and efficiency.

open-sourceai-inferencefine-tuningai-coding-assistantschina

#1329: High-Stakes Hubs vs. Remote Runways: A Pilot's Mastery

Exploring the cognitive load of busy hubs versus the technical skill required to land on the short, rocky runways of the Greek islands.

ai-inference

#1283: Is Your AI Thinking Too Much?

Stop building Rube Goldberg machines. Learn why autonomous AI agents might be the highest-interest technical debt in your stack.

multi-agent-systemsai-inferenceworkflow-automationcontext-and-memoryai-evaluation

#1282: The Geometry of Thought: The Mathematics Powering AI

Peeking under the hood of AI to discover the beautiful linear algebra and calculus that make machine reasoning possible.

transformer-architecturetraining-dataai-inferencegpusphysics

#1242: Why AI Is Rewiring the Internet's Plumbing

Forget the "cloud" metaphor. Explore the massive physical pipes, Tier-1 providers, and new fiber tech powering the 2026 AI revolution.

internet-infrastructurecloud-computingtelecommunicationsai-inferencereliability-engineering

#1227: Mojo 1.0: Can Chris Lattner Fix the AI Performance Gap?

Explore how Mojo aims to unify Python’s ease of use with C++ performance to solve the "two-language problem" in AI development.

ai-inferencegpusopen-sourcetransformer-architecture

#1224: Cracking the CUDA Code: NVIDIA’s Software Dominance

Discover why NVIDIA’s CUDA is the oxygen of the AI industry and how tools like OpenAI’s Triton are finally challenging its 20-year software moat.

ai-inferencegpusopen-sourceai-coding-assistants

#1219: Beyond the Vibes: Mastering Structured AI Outputs

Stop begging your AI for JSON. Learn how constrained decoding and strict schemas are turning "vibes" into reliable systems architecture.

model-context-protocolai-inferenceprompt-engineeringopen-source

#1218: The Architectural Divide Between Batch and Live Speech

Why does voice typing feel so clunky compared to recording a memo? We explore the technical hurdles of real-time AI transcription.

speech-recognitionai-inferencelocal-aicontext-and-memory

#1216: AI Wearables: Local Sovereignty vs. The Subscription Trap

Discover the trade-offs between sleek AI subscriptions and open-source sovereignty. Can local processing save your data from the cloud?

speech-recognitionlocal-aiai-inferenceopen-sourcedata-storage

#1212: The Postgres Vector Revolution: Killing the Sprawl

Is your tech stack a sprawling suburb of microservices? Discover why a 40-year-old database is winning the AI infrastructure war.

databasesai-inferenceragopen-sourcecontext-and-memory

#1170: The Frozen Backend Paradox: Modern Static Architecture

Explore the "frozen backend" paradox and how modern static sites use build-time logic and sharded search to mimic complex dynamic applications.

ai-inferenceai-coding-assistants

#1124: The Database Explosion: Why One Size No Longer Fits All

From vector stores to edge computing, discover why the world now has over 1,000 databases and why Postgres isn't always the answer.

databasesdata-storageai-inferenceraghallucinations

#1123: When One Database Isn't Enough

Can Postgres 18 finally replace the data warehouse? We dive into data gravity, columnar storage, and the physics of scaling in the AI age.

databasesdata-storageai-inferencecontext-and-memory

#1122: Why AI Agents Are Abandoning Human Language

Why force AI to talk like humans? Explore how agents are ditching English for high-speed "mind-melding" and latent space communication.

multi-agent-systemsai-inferencetransformer-architecturemodel-context-protocol

#1113: The Ghost Company: The High Cost of AI Agent Bureaucracy

Can a company run entirely on AI? Explore the hidden costs and "agentic bureaucracy" of building autonomous agent hierarchies.

multi-agent-systemsai-inferenceai-coding-assistantsmodel-context-protocolreasoning-models

#1109: The T-FLOP Trap: Measuring the Power of Modern AI

Are teraflops the "horsepower" of AI, or just a marketing gimmick? Explore why raw compute speed isn't the whole story in the race for AI power.

gpusai-inferencepc-hardwarereliability-engineering

#1103: The Kitchen War: When Theory Meets Messy Reality

Explore the mechanics of LLM context windows and attention, and witness what happens when technical debates collide with household chores.

context-and-memorytransformer-architectureragai-inferencecleaning

#1099: Digital Recalls: Why Your AI Is Losing Its Edge

Is your AI getting lazier? Explore the "digital recall" and why the world’s most advanced models are secretly taking steps backward.

hallucinationsai-alignmentai-evaluationfine-tuningai-inference

#1094: The CPU-First Era: Why AI is Moving Back to the Processor

Is the GPU's reign over? Discover how modern CPUs and clever optimization are bringing powerful AI models to the hardware you already own.

ai-inferencelocal-aigpushallucinationsspeech-recognition

#1088: Why AI Can Read a Library but Only Write a Postcard

Discover why frontier AI models can process millions of words but struggle to write more than a few pages without losing their logical thread.

context-and-memoryai-inferencegpustransformer-architecturehallucinations

#1085: The Tokenization Lie: How AI Actually Processes Media

Think 1,000 tokens equals 750 words? For audio and video, that rule is a lie. Discover the hidden math behind multimodal AI.

transformer-architectureai-inferencecontext-and-memoryspeech-recognitioncomputer-vision

#1084: Why AI Models Can’t Read and Your Bill Is Rising

Why does the same prompt cost more on different models? Discover the "invisible wall" of tokenization and how it shapes AI perception.

transformer-architectureai-inferencelocal-aiopen-source