Why does SFT matter for AI governance?

Common SFT datasets include OpenAssistant Conversations, Alpaca, Dolly, ShareGPT, Anthropic's HH-RLHF, and the proprietary instruction datasets used by frontier labs. SFT can use full fine-tuning or any PEFT technique like LoRA, with PEFT being the dominant choice for cost reasons. The platform streng