QLoRA

Discussed in 2 episodes

Episodes

#5411: Fine-Tuning at 4-Bit vs 16-Bit: What It Really Costs

QLoRA cuts fine-tuning VRAM 15x and cost up to 85% — but you pay in training time, quality, and safety alignment.

Main topic Sep 21
#5393: Fine-Tuning a Model on 100 Hand-Edited Answers

You don't need 10,000 examples to make a model sound like you. The real number is closer to 100 — if the edits are opinionated.

Sep 20