← Local AI

Local AI

310 episodes · Page 12 of 13

#346: GPU Scaling: The "Go Wide or Go Tall" Dilemma

Should you use a fleet of cheap GPUs or one powerhouse? Learn the math behind serverless GPU costs, cold starts, and batching efficiency.

gpusai-inferencelocal-aicloud-computing

#265: Stop Memorizing Syntax and Start Describing Results

Stop memorizing complex syntax. Explore how AI agents are transforming the terminal into a natural language "Intent-Based Interface."

ai-coding-assistantslocal-ailinuxworkflow-automation

#257: AI That Evolves: Solving the Preference Problem

Why do AI recommendations feel stuck in the past? Discover the technical hurdles of real-time learning and the future of personalized agents.

fine-tuningcontext-and-memoryai-inferencelocal-aiprompt-engineering

#206: When AI Agents Build Your Enterprise Storage at Home

Explore the power of Btrfs, ZFS, and XFS. Learn how storage pooling and snapshots create a "save point" for your entire computer.

data-storagebackups-and-archivinglinuxlocal-ai

#172: Taming the Sprawl: Building Your Cognitive AI Toolbox

Drowning in a sea of custom AI scripts? Learn how to turn disconnected "vibe-coded" tools into a unified, local-first cognitive operating system.

model-context-protocolmulti-agent-systemslocal-aiworkflow-automationopen-source

#154: From Apps to Agents: Building Your Digital Workforce

Move beyond simple prompts. Explore the architecture, autonomy, and fiscal guardrails of the next generation of AI agentic workflows.

multi-agent-systemsai-coding-assistantsworkflow-automationai-inferencelocal-ai

#153: Acoustic Hygiene: Why Your Room Is Your Most Important AI Hardware

Learn how to transform your home office into a high-performance voice-first workspace using acoustic hygiene and ergonomic IKEA furniture hacks.

speech-recognitionlocal-aiaudio-equipment

#135: Is OCR Dead? How Vision AI Is Redefining Text Extraction

Are specialized OCR tools obsolete? Herman and Corn explore how Vision Language Models are revolutionizing the way we turn images into data.

transformer-architecturecomputer-visiontraining-datahallucinationslocal-ai

#131: AI's 2026: From Invisible Agents to Physical Robots

Discover how 2026 transforms AI from a digital novelty into essential infrastructure through local agents, reasoning depth, and physical robotics.

ai-coding-assistantsmodel-context-protocollocal-aimulti-agent-systemscontext-and-memory

#126: The Cocktail Party Problem: Why AI Forgets

Why do AI models "lose the plot" after a few thousand words? Discover the mechanics of attention and the innovations solving context window limits.

transformer-architecturecontext-and-memoryai-inferencelocal-ai

#122: The Comeback of RNNs: Why Old Tech Still Matters

Herman and Corn pull back the curtain on AI to explain the mathematical "plumbing" of neural networks and the future of machine learning.

transformer-architecturetraining-dataai-inferencelocal-ai

#120: Silencing the Siren: Real-Time AI Noise Reduction

How do phones remove sirens and crying babies in real time? Explore the neural networks and hardware making crystal-clear audio possible.

speech-recognitionai-inferencelocal-aigpus

#118: AI in 2025: Is Small the New Big?

If the cost is the same, should you always use the biggest AI model? Discover why smaller models often win on speed, steering, and accuracy.

ai-inferencegpuslocal-aiai-evaluation

#110: Why Agentic AI Needs More VRAM Than You Think

Learn how to build a high-performance local AI server for agentic coding, from dual-GPU PC builds to the power of Mac's unified memory.

ai-coding-assistantslocal-aigpuscontext-and-memoryai-inference

#109: Beating Context Bloat with Dynamic Dictionaries

Tired of AI mishearing brand names? Learn how to build efficient custom dictionaries for Gemini 1.5 without breaking the bank.

speech-recognitionai-inferencecontext-and-memorylocal-ai

#99: The Mic That Hears You from Across the Desk

Tired of headsets? Herman and Corn explore professional microphone setups for seamless, high-accuracy AI voice dictation from a distance.

speech-recognitionaudio-equipmentlocal-ai

#89: The Digital Twin Dilemma: Can AI Truly Understand You?

From "digital twins" to "digital nannies," Herman and Corn explore the engineering gap between smart encyclopedias and AI that knows your soul.

context-and-memoryragai-alignmentsurveillancedigital-privacy

#88: Why Won't My AI Talk to Me First?

Why is AI always waiting for us? Herman and Corn explore the technical and social hurdles of proactive AI and the "vending machine" model.

ai-alignmentcontext-and-memorylocal-aiai-inference

#87: Why Big Tech Gives Away AI for Free

Why are tech giants spending millions on AI just to give it away? Herman and Corn dive into the strategic chess game of open-source models.

open-sourcetraining-dataai-inferencelocal-ai

#75: Community Depth vs. Raw Power in Local AI

Is Stable Diffusion becoming a relic? Corn and Herman debate the rise of Flux, the privacy of local AI, and the future of open-source generation.

local-aigenerative-mediagpusopen-source

#57: From Lawyers in Limousines to Developers in Their PJs: The Voice Tech Revolution

From limo-riding lawyers to pajama-clad coders, voice tech is booming. Discover how AI is making it a force for good.

speech-recognitionai-inferencelocal-aiai-coding-assistants

#55: Running Video AI at Home: The Real Technical Challenge

Video AI: Hype vs. Reality. Can your GPU handle it? We dive into the technical challenges of running video AI at home.

local-aigpusgenerative-mediaai-inferencetransformer-architecture

#48: Renting vs. Building: The Hidden Choices in AI Inference

Ever wonder how AI magic happens? We demystify AI inference, exploring where and how models truly operate.

ai-inferencelocal-aigpuscloud-computing

#41: The Butcher's Bargain: When Smaller AI Is Good Enough

Unlock powerful AI on your device! We demystify quantization, the ingenious trick making local AI a reality.

local-aiai-inferencegpustransformer-architecture