Transformer Architecture
215 episodes · Page 9 of 9
#116: How AI Deciphers Your Typo-Ridden Prompts
Ever wonder why AI understands your messy typos? Explore how models "denoise" chaotic input through tokenization and semantic context.
#111: Beyond Transformers: Solving the AI Memory Crisis
Why does AI forget your conversation every time you hit enter? Herman and Corn dive into the "stateless" nature of LLMs and the future of memory.
#107: The $5.5 Million Breakthrough: DeepSeek’s AI Disruption
Discover how DeepSeek-V3 is disrupting the AI market with massive cost savings and technical innovations like Multi-Head Latent Attention.
#92: Is AI Eating Its Own Trash?
Is brute force the only path to AGI? Corn and Herman explore the limits of scaling, the risk of model collapse, and the future of world models.
#85: When Probability Beats Truth: Why AI Must Lie
Why do smart AI systems make up fake facts? Corn and Herman explore the "feature" of digital hallucinations and how to spot them.
#82: The Accidental AI Engine
From video game dragons to digital brains: Herman and Corn explain why your graphics card is the secret engine behind the AI boom.
#67: Scaling or Pivoting AI for Code
Are LLMs truly the future of coding, or do they need a fundamental architectural pivot? We dive into AI's programming future.
#64: How AI Learns to See, Hear, and Think Together
AI is evolving beyond text, learning to see, hear, and understand our world. Discover the future of human-AI interaction!
#56: The Thought Experiment Nobody Runs
Building an AI model from scratch? It's a brutal reality of trillions of tokens and millions in GPUs. Discover the hidden costs of modern AI.
#55: Running Video AI at Home: The Real Technical Challenge
Video AI: Hype vs. Reality. Can your GPU handle it? We dive into the technical challenges of running video AI at home.
#54: How AI Unifies Images, Audio, and Text
Omnimodal AI: How do models process images, audio, video, and text all at once? Discover the engineering behind AI that accepts anything.
#53: Instructional vs. Conversational AI: The Distinction Nobody Talks About
Instructional vs. conversational AI: a crucial distinction reshaping how AI is built. Discover why it matters for the future of AI development.
#46: Pixels, Prompts & Pseudo-Text: AI's Word Problem
AI paints stunning images, but can't spell "cat." Why do advanced models struggle with simple text? Dive into AI's weird word problem!
#41: The Butcher's Bargain: When Smaller AI Is Good Enough
Unlock powerful AI on your device! We demystify quantization, the ingenious trick making local AI a reality.
#39: When Smaller AI Is Smarter
Forget LLMs. Discover SLMs: the specialized, efficient AI powerhouses transforming workflows, from planning to edge devices.
#37: From Keywords to Meaning: How AI Understands You
Unlock AI's secret language! Discover how vectors and embeddings create a "semantic galaxy" for true understanding and control.
#36: When Smart Software Became AI
AI isn't new. We've been using "smart software" for decades, from medical imaging to weather prediction, long before ChatGPT.
#19: AI Images: The Jigsaw Beneath the Magic
Beyond the prompt, discover the intricate 'jigsaw puzzle' of AI image generation. Uncover the magic's true workings.
#14: AGI's Crossroads: Are LLMs a "Dead End" to True AI?
Are LLMs a dead end for true AGI? We dive into the electrifying debate with AI's forefathers.
#13: AI: Not an Overnight Success Story
AI's "overnight success" is a myth. Unravel the true story behind its rise, from humble beginnings to today's innovations.
#12: The AI Breakthrough: Transformers & The Perfect Storm
AI's everywhere. How did chatbots, art, and video all emerge so suddenly? The secret lies in Transformers and a perfect storm.
#10: How ASR Went From Frustration To ... Whisper Magic
Speech to text: from frustrating to fantastic. Uncover the magic behind its rapid rise and connection to the AI boom!
#11: How Does Fine Tuning Work Anyway?
Unlock the secrets of AI fine-tuning. Discover how your small dataset can shape a giant model.