#mamba
2 episodes
The Spotlight Effect: Understanding AI Attention Mechanisms
Why do AI models "lose the plot" after a few thousand words? Discover the mechanics of attention and the innovations solving context window limits.
Beyond Transformers: Solving the AI Memory Crisis
Why does AI forget your conversation every time you hit enter? Herman and Corn dive into the "stateless" nature of LLMs and the future of memory.