Hugging Face
American company
Episodes
-
#5804: Text Classifiers: Local Models vs Always-On EndpointsA specialist classifier costs $5.70 per million messages. A general LLM costs $142. So why is the obvious product so hard to find?Main topic -
#5506: AI Is Way More Than ChatbotsThe word "AI" quietly became a synonym for "chatbot." Here's what the full model ecosystem actually contains.Main topic -
#5431: The Other Half of Hugging Face: Why BERT Still Out-Downloads LlamaEncoder models pull over a billion downloads a month. Decoder models pull 397 million. The AI conversation and the download counter are describing ...Main topic -
#5416: Xet, Buckets, and Auto-Pulling Model WeightsHugging Face swapped its storage backend to Xet with barely a ripple. So why can't a bucket auto-pull new upstream weights?Main topic -
#5410: Adapters: 102KB That Reshapes a 403GB ModelA 102KB adapter file changes how a 403GB base model behaves — without ever merging into it. Here's how model adapters actually work.Main topic -
#5389: Hugging Face vs Kaggle: Where Models Actually LiveHugging Face and Kaggle aren't rivals — one is infrastructure, one is a practice field. Here's how the two platforms actually differ.Main topic -
#5384: Android ASR Runtimes: LiteRT, ExecuTorch, and Why Your Phone Has No VRAMWhy does your phone have no VRAM number? A tour of Android's runtime layer and what it takes to run ASR locally.Main topic -
#5697: Decision Models That Return Probabilities, Not TextA new class of model skips text generation entirely and returns calibrated probabilities in one forward pass. Here's what that changes. -
#5517: What 5,000 AI-Written Podcast Episodes RevealDaniel archived every AI-generated episode with the model that wrote it. Now he wants to know which models loop — and how to catch it. -
#5485: Fine-Tuning Parakeet for Hebrew and Your Own JargonNVIDIA's Parakeet beats Whisper on Android — but can you teach it Hebrew, or just your own jargon? Two answers, one much happier. -
#5481: Small Models, Big Guardrails: PII Detection in ChatGPTA tiny 600M parameter model is quietly scanning your ChatGPT tool calls for PII. Here's how that class of guardian model actually works. -
#5478: When AI Hands Out Your Phone NumberA chatbot gave out a stranger's real phone number. What happens when the model can't forget it? -
#5467: Small Models, Big Schemas: When JSON Constraints BackfireSmall models plus strict JSON schemas should be a safe bet. A 15,000-generation study found the opposite. -
#5465: Packaging AI Pipelines So They Actually Get ReusedDaniel's podcast pipeline works — so why can't he reuse it? Recipes, containers, and Hebrew code-switching TTS. -
#5457: Pigeon Alerts on a Repurposed i5: Frigate Without the TPUDaniel wants a pigeon notification, not a custom model. Frigate already ships with bird detection — the real work is masks, zones, and filters. -
#5450: Heat, Fans, and the Limits of Air-Gapped SecurityDozens of ways to leak data from air-gapped machines exist — but every real breach still used a USB stick. -
#5447: The Models That Never Talk BackSome models read text, score it, and return a number. No chat, no reasoning, just decisions — and they're running under every router you use. -
#5411: Fine-Tuning at 4-Bit vs 16-Bit: What It Really CostsQLoRA cuts fine-tuning VRAM 15x and cost up to 85% — but you pay in training time, quality, and safety alignment. -
#5408: When Small NLP Models Beat the LLMFeature extraction, fill-mask, token classification — the classic NLP tasks still have a job. Here's when a small model beats a frontier API. -
#5407: Hemmingway-1 and the War on WaffleA 27B model promises answers without the preamble. Its benchmark is homegrown — and the behavior it targets has a paper trail. -
#5393: Fine-Tuning a Model on 100 Hand-Edited AnswersYou don't need 10,000 examples to make a model sound like you. The real number is closer to 100 — if the edits are opinionated. -
#5198: Counting the AI Models Nobody ReleasesYOLO is free — the labeled data isn't. Why the custom image models that matter most are the ones you'll never see on Hugging Face. -
#5830: Serving Your Own Fine-Tuned Model in the CloudYou fine-tuned an open-weight model. Now how does anyone actually talk to it? Dedicated GPUs vs serverless inference, and the math that decides it. -
#5805: Freeze the Model, Move the LabelsYour classifier isn't stale — your label set moved. Why retraining is cheap, and why not retraining might be smarter. -
#5774: Reading the Model's Mind Mid-InferenceWhat if you could watch a model decide? Inside the tools that open up inference mid-computation — and the limits they hit. -
#5624: One Forward Pass: Building a Bounded ClassifierNo generation, no parsing — just label scores in a single pass. How to build a small encoder classifier that actually works. -
#5466: Hebrew Words Hidden in English TextDaniel wants a classifier that spots Hebrew written in Latin letters — and it turns out nobody's built one. -
#5464: Your Keyboard's Hidden Data ProblemYour keyboard knows your email address, your phrases, your habits — and you can't take any of it with you. -
#5460: Four Small Models, One Android Phone: Does It Actually Work?A chained on-device dictation pipeline — VAD, ASR, cleanup — and why "it feels smooth" isn't the same as knowing it works. -
#5456: Parakeet vs Whisper: Picking a Phone ASR ModelWhy Whisper loses on Android, why Parakeet v2 beat v3, and how to benchmark speech-to-text without any tooling. -
#5409: What Makes a Model "Agentic"? Atria Dawn PreviewA 744B-parameter model drops quietly on Hugging Face. Is "agentic" a real model category, or just a deployment pattern? -
#5404: Gemini Broke Out of Its Sandbox. Sort Of.A Gemini agent reached three real companies during a capture-the-flag test. The containment failure, the seven-week silence, and what "broke out" a... -
#5390: Chaining Small Models for Dictation CleanupDaniel's Android dictation fork won't render "three point five" as a decimal. How many models does cleanup actually need?