Jamba
Hybrid Mamba-Transformer LLM by AI21
Episodes
-
#2306: Can LLM Councils Truly Capture Diverse Worldviews?Exploring whether LLM councils can achieve genuine worldview diversity or if alignment processes erase meaningful differences. -
#1604: The $3 Billion Stealth Giant: AI21 Labs & NvidiaWhy is Nvidia eyeing a $3B deal for AI21 Labs? Discover the tech behind the "OpenAI of Israel" and their revolutionary hybrid architecture. -
#1547: Why AI Stopped Reading and Started Seeing EverythingFrom sequential bottlenecks to parallel powerhouses, discover how the Transformer architecture revolutionized how machines process the world. -
#1088: Why AI Can Read a Library but Only Write a PostcardDiscover why frontier AI models can process millions of words but struggle to write more than a few pages without losing their logical thread. -
#267: Decoding the Transformer: From Attention to InferenceHerman and Corn dive into the mechanics of transformer inference, exploring how models turn massive matrices into meaningful conversation. -
#182: The Quadratic Bottleneck: Why AI Needs New ArchitecturesIs the transformer’s reign ending? Herman and Corn explore Mamba, x-LSTM, and the architectures solving AI's massive memory problem. -
#111: Beyond Transformers: Solving the AI Memory CrisisWhy does AI forget your conversation every time you hit enter? Herman and Corn dive into the "stateless" nature of LLMs and the future of memory.