Transformer Architecture
215 episodes · Page 6 of 9
#2016: Andrej Karpathy: The Bob Ross of Deep Learning
Why the most influential AI mind prefers a blank text file to proprietary black boxes.
#1979: When Marketing Swallows the Tech
Is AI the same as Machine Learning? We break down the nested hierarchy of artificial intelligence, from symbolic logic to neural networks.
#1964: The Three Layers That Make AR Finally Work
See a 3D arrow pointing to the exact bolt you need, or read a street sign in real-time translation.
#1962: Moravec's Paradox: Why Robots Can Write Poetry but Can't Fold a Fitted Sheet
We explore the tech letting robots "reason" about physical tasks using vision-language-action models.
#1856: Two AIs Chatting Forever: Why They Go Crazy
What happens when two ChatGPT instances talk forever? They hit a politeness loop, forget their purpose, and spiral into gibberish.
#1817: The Hidden Taxonomy of AI: Why Specialized Models Outperform Giants
Explore the vast ecosystem of niche AI models for computer vision and document understanding, far beyond large language models.
#1808: The Architecture That Made AI Voices Run on a Raspberry Pi
How a model the size of a tweet outperforms billion-dollar giants in the race for perfect AI speech.
#1799: The Original AI Blueprints: BERT & CLIP
Before GPT, two models changed everything. Discover how BERT and CLIP taught machines to read and see the world.
#1792: Google's Native Multimodal Embedding Kills the Fusion Layer
Google’s new embedding model maps text, images, audio, and video into a single vector space—cutting latency by 70%.
#1739: AI Just Designed a New Life Form
Meet Evo: the 40B parameter AI that writes DNA, designs novel CRISPR systems, and is reshaping synthetic biology.
#1724: When AI Dubbing Swaps Your Gender
How does YouTube translate a video with one click? We explore the tech behind auto-dubbing, from sandwich models to voice cloning.
#1705: Microsoft's Phi: The Small Model Bet for Agentic AI
Microsoft is pushing small language models like Phi for agentic AI. Here’s why that strategy matters for speed, cost, and edge computing.
#1680: Beyond China: AI in Russia, India, Japan
China dominates the AI conversation, but Russia, India, and Japan are building powerful regional models with unique architectures.
Also available in:Русский#1679: Efficiency Over Scale: How Export Controls Forced a Smarter AI
DeepSeek and MiMo are topping developer charts, but they're not just cheaper clones. Here's why their design philosophy is fundamentally different.
#1668: Kimi K2's Hidden Reasoning: A New AI Architecture
Moonshot AI's Kimi K2 Thinking model uses a hidden reasoning phase to solve complex logic puzzles and coding tasks, beating top proprietary models.
#1630: When a Reasoning Model Overthinks Comedy
Xiaomi’s new MiMo 2.0 Pro model auditions for a comedy podcast, promising deep reasoning over raw speed.
#1610: Mistral AI: Europe’s High-Stakes Play for AI Sovereignty
Explore how Mistral AI is challenging Silicon Valley with efficient models, strategic partnerships, and the new Voxtral voice model.
Also available in:Français#1609: IBM Granite 4.0: The Industrial Workhorse of Business AI
Forget flashy chatbots. Discover how IBM is building high-efficiency, industrial-grade AI models designed to run the world's biggest businesses.
#1606: DeepSeek’s Return: V4, R2, and the AI Pricing War
DeepSeek returns with a trillion-parameter model and rock-bottom pricing. Explore the tech behind V4 and the mystery of the Hunter Alpha leak.
#1605: Alibaba’s Qwen 3.5: The New King of Intelligence Density
Alibaba’s Qwen 3.5 is rewriting the AI rulebook. Discover how small models are outperforming giants through extreme "intelligence density."
#1604: The $3 Billion Stealth Giant: AI21 Labs & Nvidia
Why is Nvidia eyeing a $3B deal for AI21 Labs? Discover the tech behind the "OpenAI of Israel" and their revolutionary hybrid architecture.
#1599: Xiaomi's Ghost Model: How Anonymous Testing Built an AI Empire
Xiaomi’s MiMo-V2 is here. Discover how the "Agent Era" is turning hardware into a trillion-parameter brain for your home and car.
#1585: The End of the Digital Sandwich: How AI Learns to Speak Your Language
Explore how new omnilingual models are collapsing the Tower of Babel, moving from rigid translation to a universal understanding of human speech.
#1559: Dark Knowledge: The Art of AI Model Distillation
Discover how model distillation transfers "dark knowledge" from massive AI giants into tiny, efficient models that live in your pocket.