Local AI
313 episodes · Page 8 of 14
#2349: The 30-Person Lab Outpacing AI Giants
Discover how Arcee AI’s Trinity Large Thinking delivers cutting-edge reasoning at a fraction of the cost, all from a team of just 30.
#2337: When Diarization Fails Silently
Discover how PyAnnote and other tools tackle the critical task of identifying "who spoke when" in audio—and why it’s harder than it sounds.
#2326: Voice Control Simplified: Home Assistant’s Local Stack
Discover how to build a reliable, vendor-agnostic voice control system for Home Assistant without relying on Amazon or Google.
#2325: Why Depth Is the Hardest Thing for AI to See
Can AI turn your apartment photos into a precise 3D model? Explore the tech behind photogrammetry and spatial reconstruction.
#2314: One Model or Three? Inside Claude's Architecture
What makes Claude’s Haiku, Sonnet, and Opus different? Discover how architecture shapes their unique strengths and weaknesses.
#2312: When Bigger Context Windows Aren't Better
Exploring the real-world impact of massive context windows in AI models, from academic research to codebase analysis.
#2311: Danish AI: Bridging the Localization Gap
How does AI handle Danish? Explore the challenges and progress in making AI tools work for small-language populations.
#2288: The Invisible Gatekeeper of Voice Tech
How voice activity detection shapes every step of the voice tech pipeline, and why it’s harder than it seems.
#2274: Weekend Projects Gone Wild: Evaluating AI Startup Pitches
From fridge tax agents to guilt-scheduled cron jobs, we evaluate ten AI-driven startup ideas that could exist—but probably shouldn’t.
#2271: Vector Search in a Single File
What if you could do vector search with just SQLite? We explore sqlite-vec, the extension that adds embeddings to the world's simplest database, an...
#2193: Running Claude in Your Apartment (The Physics Says No)
Building a local AI inference server to rival Claude Code sounds great until you do the math on heat, noise, and neighbor relations.
#2175: Let Your AI Argue With Itself
What happens when you let multiple AI personas debate each other instead of asking one model one question? A deep dive into synthetic perspective e...
#2074: Generative Social Science: When AI Agents Develop Theory of Mind
See how a new framework models 10,000 virtual citizens to test policies before spending a dime.
#2067: MoE vs. Dense: The VRAM Nightmare
MoE models promise giant brains on a budget, but why are engineers fleeing back to dense transformers? The answer is memory.
#2065: Why Run One AI When You Can Run Two?
Speculative decoding makes LLMs 2-3x faster with zero quality loss by using a small draft model to guess tokens that a large model verifies in para...
#2041: The "MPEG Moment" for AI: Llamafile & Native Models
Why are we squeezing massive cloud models onto desktops? Meet the "native" AI revolution.
#2040: The Rebellion Against Big Tech's AI Lock-In
Why run LLMs locally? We break down Ollama, llama.cpp, vLLM, and llamafile—and when to use each.
#2038: UI-First vs Architecture-First: Choosing Your AI Agent
LobeHub vs. Dify vs. n8n: We break down the chaotic landscape of local AI agents to find the right "brain" for your workflow.
#2027: The Missing Photoshop for Words
Why is editing text with AI so clunky? We explore the "TITO" paradigm—using small, local models for fast, private text transformation.
#2019: Local AI vs Cloud AI: The Agent Identity Crisis
Your desktop is becoming a life support system for AI agents. We explore the sharp trade-offs between local-first and cloud-native architectures.
#2017: The Art of Squeezing AI Models onto Your GPU
Those cryptic letters on Hugging Face actually map how much brain power you trade for speed.
#2016: Andrej Karpathy: The Bob Ross of Deep Learning
Why the most influential AI mind prefers a blank text file to proprietary black boxes.
#1986: Desk Robots: Privacy, Power, or Annoyance?
These AI companions sit on your desk, watching your posture and listening in—so how do they protect your privacy while actually being useful?
#1964: The Three Layers That Make AR Finally Work
See a 3D arrow pointing to the exact bolt you need, or read a street sign in real-time translation.