Mixtral 8x7B
Mixture of Experts model with eight experts
Episodes
-
#4669: What "Distribution" Really Means in AI ModelsUnpacking what "distribution" actually means under the hood — and why training data variety shapes model behavior. -
#2413: When Your AI Says No to EverythingWhy LLMs refuse 73% of harmless prompts — and the trade-off between safety and usefulness. -
#2409: When AI Cheats on Cultural KnowledgeFive benchmarks that reveal how AI systems fail at cultural knowledge — and what their methodologies tell us.