← GPUS

GPUS

225 episodes · Page 5 of 10

#2426: Why DeepSeek V4's Prose Feels More Vivid Than Claude or GPT

A million-token context window at 2% the KV-cache cost — and prose that actually breathes. Here's what makes V4 different.

open-sourcetransformer-architectureai-inferencegpustraining-data

#2402: Geospatial Gold Rush: Who's Hiring Satellite Sleuths?

From crop health to cargo routes, discover which industries are paying top dollar for geospatial analysis skills—and the tools they use daily.

gpusopen-sourceworkplace-culture

#2374: How Granular Can MoE Experts Get?

Exploring the limits of expert granularity in Mixture of Experts models—how narrow can segmentation go before efficiency or accuracy suffers?

transformer-architectureai-inferencegpustraining-data

#2350: NVIDIA's Strategic Pivot: From Chipmaker to Model Builder

Dive into NVIDIA’s Nemotron 3 Super, a hybrid MoE model combining Mamba, Transformers, and multi-token prediction for cutting-edge efficiency.

transformer-architectureai-inferencegpusopen-source

#2335: Staking Out the Middle: UK's Post-Brexit AI Strategy

The UK’s £500M Sovereign AI Fund is a bold move to boost domestic AI startups with compute access, visas, and strategic partnerships. How does it s...

investingcurrency-and-exchange-ratesai-inferencegpuslegislation

#2307: Inside Frontier LLM Training: Stages, Costs, and Checkpoints

Discover the multi-stage process of training frontier large language models, from pretraining to post-training, and why checkpoints are the key to ...

fine-tuningtraining-dataai-inferencegpusai-alignment

#2303: The Serverless Paradox: Why TTS Eats Your Budget

How batch processing and smart queue management can slash TTS costs for episodic podcast production.

ai-inferencegpusspeech-recognitiontext-to-speechcontainers-and-virtualization

#2295: Why Taiwan's Automation Strategy Leaves the West Behind

Asus has achieved 85% automation in motherboard production—how did they outpace Western competitors?

gpusai-inferencemanufacturingmarket-competition

#2256: The One-Charger Dream: Specs, Trade-offs, and Reality

Drowning in chargers? We break down the specs for a single, powerful desktop charging station that can handle laptops, phones, and more—and where t...

batteries-and-powerelectronicsgpus

#2235: What IP68 Actually Means (And Doesn't)

IP ratings, MIL-STD-810, drop tests—consumer gear is covered in durability labels. But what do they actually guarantee?

gpus

#2227: Why Groq's Chip Flips the AI Hardware Script

ai-inferencegpushallucinations

#2193: Running Claude in Your Apartment (The Physics Says No)

Building a local AI inference server to rival Claude Code sounds great until you do the math on heat, noise, and neighbor relations.

local-aiai-coding-assistantsgpusai-inferencepower-outages

#2177: Skip Fine-Tuning: Shape LLMs With Alignment Alone

Can you build a personalized LLM by skipping traditional fine-tuning and using only post-training alignment methods like DPO and GRPO? We break dow...

fine-tuningai-alignmentai-inferencegpusprompt-engineering

#2160: Claude's Latency Profile and SLA Guarantees

Claude is measurably slower than competitors—and Anthropic's SLA promises are even thinner than the latency numbers suggest. What enterprises actua...

ai-inferenceai-evaluationai-coding-assistantsgpus

#2115: Why AI Answers Differ Even When You Ask Twice

You ask an AI the same question twice and get two different answers. It’s not a bug—it’s physics.

ai-inferencegpusai-evaluationhallucinations

#2101: Why USB-C Handshakes Hate Solar Power

Cheap solar chargers often fail to charge devices due to USB-C handshake issues and heat inefficiencies.

electronicshallucinationsbatteries-and-powergpuscryptography

#2098: The Invisible War for the Radio Spectrum

Modern wars are won by controlling invisible waves, not just physical ground. Discover how electronic and cyber warfare merge to rewrite reality.

electronic-warfarecyberattacksgpusdronesmilitary-strategy

#2088: Quantum's First Real Benchmarks Are Here

From drug discovery to logistics, quantum computing is finally delivering measurable speedups over classical systems.

gpusai-inferencematerials-sciencesustainabilityinvesting

#2067: MoE vs. Dense: The VRAM Nightmare

MoE models promise giant brains on a budget, but why are engineers fleeing back to dense transformers? The answer is memory.

transformer-architectureai-inferencegpuslocal-aifine-tuning

#2065: Why Run One AI When You Can Run Two?

Speculative decoding makes LLMs 2-3x faster with zero quality loss by using a small draft model to guess tokens that a large model verifies in para...

ai-inferencegpustransformer-architecturelocal-ai

#2063: That $500M Chatbot Is Just a Base Model

That polite chatbot? It started as a raw, chaotic autocomplete engine costing half a billion dollars to build.

training-datagpusfine-tuningai-inference

#2061: The Memory Bottleneck That Drives Attention Design

Attention is the engine of modern AI, but it’s also a memory hog. Here’s how MQA, GQA, and MLA evolved to fix it.

transformer-architectureai-inferencecontext-and-memorygpus

#2041: The "MPEG Moment" for AI: Llamafile & Native Models

Why are we squeezing massive cloud models onto desktops? Meet the "native" AI revolution.

local-aifine-tuningai-inferencegpusopen-source

#2040: The Rebellion Against Big Tech's AI Lock-In

Why run LLMs locally? We break down Ollama, llama.cpp, vLLM, and llamafile—and when to use each.

local-aiai-inferenceopen-sourcegpustransformer-architecture