← GPUS

GPUS

226 episodes · Page 7 of 10

#1604: The $3 Billion Stealth Giant: AI21 Labs & Nvidia

Why is Nvidia eyeing a $3B deal for AI21 Labs? Discover the tech behind the "OpenAI of Israel" and their revolutionary hybrid architecture.

fine-tuningai-inferencetransformer-architectureopen-sourcegpus

#1556: The War Against Latency: Engineering Real-Time AI

From KV cache monsters to sub-100ms response times, explore the hardware and software innovations making real-time AI a reality.

ai-inferencegpuscontext-and-memoryspeech-recognitiontransformer-architecture

#1555: Beyond Whisper: NVIDIA’s Real-Time Speech Revolution

Move over Whisper. NVIDIA's new models offer 10x speed increases and better accuracy for real-time speech-to-text.

speech-recognitionai-inferencelocal-aigpusopen-source

#1548: The Infrastructure That Kills the Cold Start

Stop waiting for containers to warm up. Discover how Modal is reinventing GPU infrastructure to eliminate friction in AI development.

cloud-computinggpuscontainers-and-virtualizationai-inference

#1544: Why It Costs More to Run AI Than to Build It

Discover why the AI runtime is the unsung hero of the tech stack, determining whether your AI feels like a snappy conversation or a slow crawl.

ai-inferencelocal-aigpusopen-source

#1541: Why Your Phone Beats Your PC at Video

Explore why mobile devices handle real-time video AI better than desktops and how the NPU gap is finally closing in 2026.

local-aiai-inferencecomputer-visiongpushallucinations

#1538: The Cold Monetization Era: Why AI Limits are Here to Stay

Why is your $200 AI plan hitting limits? Discover the hidden costs of reasoning tokens and the physical bottlenecks of the 2026 AI energy crisis.

ai-inferencegpusai-coding-assistantscontext-and-memory

#1479: The Speed of Thought: Inside the New Era of Inference

The war for model size is over. Explore the engineering breakthroughs making massive AI models faster than human thought.

ai-inferencetransformer-architecturegpuslocal-ai

#1282: The Geometry of Thought: The Mathematics Powering AI

Peeking under the hood of AI to discover the beautiful linear algebra and calculus that make machine reasoning possible.

transformer-architecturetraining-dataai-inferencegpusphysics

#1227: Mojo 1.0: Can Chris Lattner Fix the AI Performance Gap?

Explore how Mojo aims to unify Python’s ease of use with C++ performance to solve the "two-language problem" in AI development.

ai-inferencegpusopen-sourcetransformer-architecture

#1224: Cracking the CUDA Code: NVIDIA’s Software Dominance

Discover why NVIDIA’s CUDA is the oxygen of the AI industry and how tools like OpenAI’s Triton are finally challenging its 20-year software moat.

ai-inferencegpusopen-sourceai-coding-assistants

#1199: When Biology Becomes a Garage Hobby

From garage-made vaccines to 200 million protein structures, AlphaFold is turning the building blocks of life into a software problem.

ai-securityopen-sourcegpusai-evaluationanimals

#1109: The T-FLOP Trap: Measuring the Power of Modern AI

Are teraflops the "horsepower" of AI, or just a marketing gimmick? Explore why raw compute speed isn't the whole story in the race for AI power.

gpusai-inferencepc-hardwarereliability-engineering

#1104: Reclaiming the Silicon Lottery

Peek inside the silicon to discover how CPUs process instructions and why undervolting is the secret to unlocking hidden performance.

pc-hardwareelectronicsreliability-engineeringgpus

#1102: Beyond the Boost: Mastering Modern GPU and RAM Tuning

Is manual hardware tuning still worth it? Discover why undervolting and curve optimization are the new secrets to peak PC performance.

gpuspc-hardwareelectronicsreliability-engineering

#1094: The CPU-First Era: Why AI is Moving Back to the Processor

Is the GPU's reign over? Discover how modern CPUs and clever optimization are bringing powerful AI models to the hardware you already own.

ai-inferencelocal-aigpushallucinationsspeech-recognition

#1088: Why AI Can Read a Library but Only Write a Postcard

Discover why frontier AI models can process millions of words but struggle to write more than a few pages without losing their logical thread.

context-and-memoryai-inferencegpustransformer-architecturehallucinations

#1081: The K-V Cache: Solving AI’s Invisible Memory Tax

Why does your AI get slower as you chat? Discover the K-V cache, the invisible bottleneck of generative AI, and how we're fixing it in 2026.

ai-inferencecontext-and-memorygpustransformer-architecturelocal-ai

#1078: The Agentic Throughput Gap: Why Your AI Hits a Wall

Stop hitting 429 errors. We explore why AI agents crash into rate limits and how to build high-throughput systems that never sleep.

ai-coding-assistantsai-inferencelocal-aigpuscontext-and-memory

#1077: Will Your Browser Replace Your OS for Local AI?

See how Web GPU and Web NN are turning your browser into a local AI engine, ending the era of complex DIY setups and protecting your privacy.

model-context-protocollocal-aigpusai-inferencecyberattacks

#1034: Why a Supercomputer Isn't Just a Faster Desktop

Explore the massive scale of supercomputing, from the memory wall to liquid-cooled racks pushing the limits of physical simulation.

gpuscloud-computinglinuxtaxonomy-and-classification

#940: Ergonomics Under Fire: Building a Command Center in a War Zone

Stop hunching over your laptop. Learn how to build a pro-grade, ergonomic workstation that fits in your backpack without breaking your back.

ergonomicshvacgpusbatteries-and-powerwi-fi

#827: When Military Tunnel Tech Maps the City Below

Explore the cutting-edge technology used to map the hidden world beneath our feet, from military tunnels to urban infrastructure.

gpuselectronic-warfaredigital-privacysensory-processing

#781: From Monolith to Constellation: Why AI Hubs Are Specializing

Explore how the US AI map is shifting in 2026, from San Francisco’s frontier labs to the specialized industrial hubs of Houston and NYC.

ai-alignmentopen-sourcegpus