whisper.cpp
C++ Whisper port for CPU inference
Episodes
-
#4972: CPU vs GPU Inference: When to Skip the GPUWhy running AI on CPU isn't a toy — and when the GPU advantage vanishes. -
#4920: Local Dictation on Android: The Real BottlenecksWhy on-device speech-to-text on Android hits a wall at 30 seconds — and what silicon actually matters. -
#4919: Parakeet vs Whisper: On-Device Dictation ShowdownNVIDIA Parakeet beats Whisper on phone dictation despite having more parameters. Here's why architecture matters more than model size. -
#4717: Building a Home Whisper Server: The Full SpecDaniel wants a dedicated home server for Whisper dictation. Here's the exact build — GPU, RAM, storage, and runtime — to make it work. -
#4455: Borrowing a GPU Over Your Home NetworkCan you use your desktop's AMD GPU from a laptop as if it were local? We explore the real options. -
#1540: Why Gnome 50 is Breaking Your Voice-to-Text ToolsExplore the engineering battle to bring low-latency AI voice input to Linux while navigating the strict security of Wayland and GNOME 50. -
#1539: Escaping the Cloud Dictation TrapStop shouting at your phone. Discover how dedicated hardware and local AI are making instant, private voice-to-text a reality. -
#3: Safetensors or something else: STT inference formats explainedUnpacking ASR weight formats: Safetensors and beyond. Tune in to understand the distinctions. -
#5: Fine-Tuning ASR For Maximal UsabilityFine-tuned ASR is just the start. Discover the next steps for deployment and maximizing usability. -
#11: How Does Fine Tuning Work Anyway?Unlock the secrets of AI fine-tuning. Discover how your small dataset can shape a giant model. -
#2: Local STT For AMD GPU OwnersAMD GPU? No problem! Dive into local AI adventures like on-device speech to text. -
#8: Building Your Own WhisperEver wondered if you could build your own speech recognition tool? We dive deep into crafting custom ASR. -
#4: If Your Voice Ages, Does Your Fine-Tune Become Useless?Your voice changes, but your fine-tuned model shouldn't become useless. We explore the biology of the larynx and ASR. -
#9: Benchmarking Custom ASR Tools - Beyond The WERBenchmarking custom ASR fine-tunes: We're diving deep beyond the WER to truly measure performance. -
#7: Building Custom ASR ToolsEver wondered how to build your own ASR tools from scratch? Discover the why and how in this episode!