Common Crawl
Open repository of web crawl data
Episodes
-
#5117: How AI Training Data Gets Filtered (and Exploited)Six stages of content filtering stand between raw web crawls and your AI model — here's where poisoning attacks slip through. -
#5116: Beyond Common Crawl: The Datasets Shaping AICommon Crawl is just the bulk flour. We explore the curated datasets that actually shape what AI models know and do. -
#5113: Can Rival Labs Poison AI Training Data?A few hundred crafted documents can shift a model's stance. Here's how data poisoning actually works. -
#2316: Who’s Building AI’s Next Training Data?How boutique dataset firms are reshaping AI training, from rights-cleared content to domain-specific precision. -
#2092: Why AI Thinks You're American (Even When You're Not)Even when we tell Gemini we're in Jerusalem, it defaults to US-centric assumptions. We explore the root causes of this persistent AI bias. -
#2056: Music as Language: The Architecture Behind AI Song GenerationA look at how AI music models use audio tokens, transformers, and diffusion to turn text into songs. -
#1909: The Unbakeable Cake: AI's Copyright ProblemWhy can't we just delete stolen data from AI models? It's not a database—it's a baked cake. -
#1839: AI's Data Kitchen: From Hoovering to Fine-TuningWe go behind the curtain of the AI data pipeline, revealing the messy, multi-billion-dollar war over data curation. -
#1151: Is RLHF Lobotomizing AI? Why Guardrails Kill IQAre safety guardrails making AI less intelligent? Explore the "alignment tax" and why corporate filters might be lobotomizing our best tools. -
#714: The Billion-Year Backup: Escaping the Digital Dark AgeWill our digital legacy survive for billions of years? Explore the tech fighting the "Digital Dark Age," from lunar libraries to quartz glass. -
#666: Why It Costs More to Talk to AI in Your Native TongueIs AI truly universal, or are we trapped in an English-speaking bubble? Discover how the "tokenization tax" impacts global AI equity. -
#664: Which Phase Bakes in More Bias?Is AI a neutral oracle or a mirror of our biases? Explore how training data and human feedback shape the cultural "soul" of modern models. -
#272: The Bill is Due: AI Training and Intellectual PropertyCan you "untrain" an AI? Herman and Corn explore the legal and technical battle over copyrighted data and the future of machine unlearning. -
#258: The Geographic Soul of AI: Mapping the Global Data DivideWhy does an AI see a Chinese supermarket instead of a Western one? Explore how training data shapes the cultural worldview of modern models. -
#68: The Looming Digital Ice Age: AI Eating Itself?Is AI eating itself? Explore the "model collapse" and the "Hapsburg AI problem" before our digital world speaks only gibberish. -
#56: The Thought Experiment Nobody RunsBuilding an AI model from scratch? It's a brutal reality of trillions of tokens and millions in GPUs. Discover the hidden costs of modern AI. -
#23: Common Crawl's Cultural BlindspotUncover the unseen influences shaping AI. We dive deep into training data, bias, and Common Crawl.