ROCm
AMD's open compute software platform
Episodes
-
#6198: Benchmarking a TTS Model on Your Own GPUReal-time factor, warm-up artifacts, and why an 8-bit quantized speech model might not run any faster. -
#5991: Batch Inference on Your Own GPU: vLLM, SGLang, Ollama, llama.cppHosted batch APIs sell you half-price tokens. Here's how to get the same file-in, file-out workflow on your own Linux box. -
#5969: Ubuntu 26.04 LTS: Is Staying on LTS Still a Trade-Off?Ubuntu 26.04 LTS shipped in April. Point releases, HWE kernels, and SRUs have quietly closed most of the freshness gap — but not everywhere. -
#5900: Serving DeepSeek-V4.1-Flash on Your Own GPUFive inference engines, one frontier MoE, and a shortlist that collapses depending on which GPU you already bought. -
#5898: ROCm 10.1: AMD's Software Stack Finally Grows UpThree ROCm releases in six months — build system, agentic tooling, data movement. What actually changed for AMD GPU owners. -
#1807: The ABI Trap: Why GPUs Break Docker's PromiseDocker promised "run anywhere," but GPU images make you compile for hours. Here’s why the abstraction breaks down. -
#1224: Cracking the CUDA Code: NVIDIA’s Software DominanceDiscover why NVIDIA’s CUDA is the oxygen of the AI industry and how tools like OpenAI’s Triton are finally challenging its 20-year software moat. -
#34: Red Team vs. Green: Local AI Hardware WarsNVIDIA's CUDA rules AI, leaving AMD users battling a "green wall." Explore the hardware wars and thorny paths forward. -
#27: Choosing Your AI Environment: Host, Conda, or Docker?Tired of AI environment headaches on AMD? We demystify Conda, Docker, and host environments to unlock your GPU's full potential. -
#25: The Open-Source Battle for AI's Hardware SoulUnraveling how GPUs power AI. We dive into CUDA, ROCm, and the software stack that makes it all think. -
#5: Fine-Tuning ASR For Maximal UsabilityFine-tuned ASR is just the start. Discover the next steps for deployment and maximizing usability. -
#9: Benchmarking Custom ASR Tools - Beyond The WERBenchmarking custom ASR fine-tunes: We're diving deep beyond the WER to truly measure performance. -
#4: If Your Voice Ages, Does Your Fine-Tune Become Useless?Your voice changes, but your fine-tuned model shouldn't become useless. We explore the biology of the larynx and ASR. -
#2: Local STT For AMD GPU OwnersAMD GPU? No problem! Dive into local AI adventures like on-device speech to text. -
#11: How Does Fine Tuning Work Anyway?Unlock the secrets of AI fine-tuning. Discover how your small dataset can shape a giant model.