Axolotl
Multi-GPU fine-tuning with FSDP and DeepSpeed
Episodes
-
#5937: The Fine-Tuning Career: Titles, Skills, and What It PaysThe job above the labeling layer exists — it just doesn't have one name. What it takes, what it pays, and how to sell it. -
#5411: Fine-Tuning at 4-Bit vs 16-Bit: What It Really CostsQLoRA cuts fine-tuning VRAM 15x and cost up to 85% — but you pay in training time, quality, and safety alignment. -
#3406: LoRA Isn’t Just for Image GenerationLoRA lets you fine-tune an LLM’s behavior with a 50MB file. Here’s how it works and why it matters. -
#2495: How to Bake Personality Into an LLM in 15 MinutesFine-tune a model's personality with ~300 examples and a consumer GPU. SFT + DPO explained.