Gemma 4
Google's fine-grained MoE model with 128 experts
Episodes
-
#6009: Vertex AI Is Now the Gemini Agent PlatformVertex AI just became the Gemini Enterprise Agent Platform. Here's the family tree, the five products, and when to actually move. -
#2488: Hybrid Pipelines for Entity ResolutionClassic NLP pipelines vs. lightweight LLMs for handling Hezbollah’s half-dozen spellings. -
#2374: How Granular Can MoE Experts Get?Exploring the limits of expert granularity in Mixture of Experts models—how narrow can segmentation go before efficiency or accuracy suffers? -
#1940: Why Google's 31B Model Fits in Your GPUGoogle just dropped Gemma four, and its 31-billion-parameter size is a masterclass in hardware-aware AI design.