• Decrease Text SizeIncrease Text Size

How does PEFT work?

The canonical PEFT methods include LoRA, QLoRA, prefix tuning, prompt tuning, adapter layers, and IA3, each making different choices about where in the architecture to inject the trainable parameters. PEFT dramatically reduces training cost, storage cost (small adapters versus full model copies), and risk of catastrophic forgetting compared to full fine-tuning. The platform strengthens enterprise re