TensorRT
NVIDIA inference optimization runtime
Episodes
-
#5419: The Attention Budget in Your PocketWhy phone dictation runs out of room, and how bounded attention windows buy you punctuation without blowing your memory budget. -
#5198: Counting the AI Models Nobody ReleasesYOLO is free — the labeled data isn't. Why the custom image models that matter most are the ones you'll never see on Hugging Face. -
#4919: Parakeet vs Whisper: On-Device Dictation ShowdownNVIDIA Parakeet beats Whisper on phone dictation despite having more parameters. Here's why architecture matters more than model size.