GPTQ
GPU-only quantization method
Episodes
-
#2017: The Art of Squeezing AI Models onto Your GPUThose cryptic letters on Hugging Face actually map how much brain power you trade for speed. -
#41: The Butcher's Bargain: When Smaller AI Is Good EnoughUnlock powerful AI on your device! We demystify quantization, the ingenious trick making local AI a reality.