Series

Synthetic Data

Generating training data with models: privacy, preference data, weak supervision and model collapse.

10 episodes
  1. 1

    The Looming Digital Ice Age: AI Eating Itself?

    Is AI eating itself? Explore the "model collapse" and the "Hapsburg AI problem" before our digital world speaks only gibberish.

    22:12 · 22 Dec 2025
  2. 2

    Can Fictional Twins Save AI From Running Out of Internet?

    As high-quality human data runs dry, synthetic data is becoming the new gold standard for training the next generation of AI models.

    17:20 · 23 Mar 2026
  3. 3

    Substitution Anonymization: Privacy Without Utility Loss

    How to generate realistic synthetic voice notes and calendar data with zero PII exposure risk.

    24:41 · 27 Apr 2026
  4. 4

    AI Training Itself: Student, Teacher, and Grader

    Can models generate their own training data and judge their own outputs? The promise and pitfalls of fully AI-led pipelines.

    28:45 · 5 May 2026
  5. 5

    Training a Model When You Don't Know the Labels Yet

    Daniel wants to extract adapter specs from his shelf — but he can't name the labels until he's already annotating.

    26:33 · 13 Oct 2026
  6. 6

    How to Build an AI Preference Dataset

    Pairwise comparison, forced choice, or just "this one or that one" — the engineering behind collecting human preferences on AI outputs.

    22:35 · 19 Oct 2026
  7. 7

    Who Checks the Labels? Weak vs Strong Supervision

    Human labels, rule-based labels, or a teacher model writing the exam — what actually makes supervision "strong," and who verifies it?

    31:06 · 20 Oct 2026
  8. 8

    Which AI Models Actually Generate Good Training Data?

    Open weights vs closed APIs for synthetic data, and why IFEval scores don't tell you which model will hold up.

    21:45 · 24 Oct 2026
  9. 9

    Small Models, Big Questions: When Cheap Fables Get Expensive

    Three million fables for pennies — but can a small model tell a good example from a plausible one?

    21:43 · 24 Oct 2026
  10. 10

    Synthetic Logs Without Leaking Your Clients

    You can rewrite your logs with a cheap model — but can you keep the task boundaries while losing the client names?

    24:27 · 24 Oct 2026