Context and Memory
299 episodes · Page 12 of 13
#336: The World Model Revolution: Beyond LLM Token Prediction
Herman and Corn explore why LLMs struggle with logic and how the shift to world models is giving AI a sense of physics and spatial reality.
#322: Why You Can't Stop Thinking About Work After 5 PM
Struggle to shut down your brain at night? Discover how a simple voice note can bridge the gap between today’s work and tomorrow’s flow.
#267: Decoding the Transformer: From Attention to Inference
Herman and Corn dive into the mechanics of transformer inference, exploring how models turn massive matrices into meaningful conversation.
#259: When AI Argues with Reality: Mastering Search Grounding
Is your AI gaslighting you about the current date? Learn how to force LLMs to trust live search results over their outdated training data.
#257: AI That Evolves: Solving the Preference Problem
Why do AI recommendations feel stuck in the past? Discover the technical hurdles of real-time learning and the future of personalized agents.
#200: Why Graph RAG Beats Flat Vectors for AI Memory
Explore how the AI stack is evolving from simple vector search to complex Graph RAG and why the "boring" Postgres database is winning the race.
#182: The Quadratic Bottleneck: Why AI Needs New Architectures
Is the transformer’s reign ending? Herman and Corn explore Mamba, x-LSTM, and the architectures solving AI's massive memory problem.
#181: Why Your AI Is Finally Stopping to Think
Discover how AI shifted from instant reflexes to deep reflection through inference-time compute and hidden reasoning steps.
#171: From Digital Fortresses to Machine-Digestible Sites
Stop fighting the crawlers and start feeding them. Learn how llms.txt and structured metadata are defining the new era of AI Optimization.
#158: The Power of the Jagged Profile: Beyond Specialization
Are you a jack of all trades or a master of synthesis? Explore how neurodivergence and multipotentialism are redefining success in the age of AI.
#155: Building an Ideation Factory: Beyond Generic AI Ideas
Learn how to overcome AI repetition and build a multi-agent "ideation factory" to solve complex local economic challenges.
#145: The Ergonomic Case for Eyes-Free Computing
Tired of being tethered to your screen? Herman and Corn explore the future of voice-first productivity and the rise of autonomous AI agents.
#144: AI Memory vs. RAG: Building Long-Term Intelligence
Explore why AI needs a "diary" and not just a "library" as we dive into the architectural differences between RAG and long-term agentic memory.
#133: When Quantum Computing Becomes Accessible
Discover how quantum computing is transforming AI from brute-force scaling to surgical precision in this deep dive into the 2026 tech landscape.
#132: How AI Learns to See Time as a Dimension
Discover how spatial-temporal tokenization and 3D world modeling are revolutionizing real-time video-to-video AI interaction.
#131: AI's 2026: From Invisible Agents to Physical Robots
Discover how 2026 transforms AI from a digital novelty into essential infrastructure through local agents, reasoning depth, and physical robotics.
#129: Stop Writing Prompts and Start Writing Constitutions
Is prompt engineering a dying art? Herman and Corn explore why the future of AI lies in context, domain expertise, and outcome architecture.
#128: AI’s Dial-Up Era: Looking Back from 2036
Herman and Corn explore why today's AI prompts and latency will look like "dial-up modems" to our future selves in 2036.
#127: Modular Code Indexing: Separating AI Memory from Intelligence
#126: The Cocktail Party Problem: Why AI Forgets
Why do AI models "lose the plot" after a few thousand words? Discover the mechanics of attention and the innovations solving context window limits.
#117: From Keywords to Vectors: How AI Decodes Meaning
Why can AI write poetry but struggle to find a file? Explore the history and math of semantic understanding with Herman and Corn.
#111: Beyond Transformers: Solving the AI Memory Crisis
Why does AI forget your conversation every time you hit enter? Herman and Corn dive into the "stateless" nature of LLMs and the future of memory.
#110: Why Agentic AI Needs More VRAM Than You Think
Learn how to build a high-performance local AI server for agentic coding, from dual-GPU PC builds to the power of Mac's unified memory.
#109: Beating Context Bloat with Dynamic Dictionaries
Tired of AI mishearing brand names? Learn how to build efficient custom dictionaries for Gemini 1.5 without breaking the bank.