How does Prompt Tuning work?

Unlike prefix tuning which operates at every attention layer, prompt tuning operates only at the input layer, making it the simplest and most parameter-efficient PEFT method — typically training just a few thousand parameters total. The technique works surprisingly well at very large model scales (10B+ parameters) where the rich pretrained representations can absorb the soft prompt as effective task conditioning. The platform strengthens ente