What is Prefix Tuning?

Prefix tuning is a PEFT technique introduced by Li and Liang (2021) that prepends a small sequence of learned continuous vectors (the prefix) to every layer's attention input, allowing task adaptation without modifying any of the model's frozen parameters. The platform strengthens enterpris