Where is Self-Attention used in practice?

Self-attention is the single most important innovation in the Transformer paper, and every variant of modern LLMs uses some form of self-attention. AI governance teams encounter self-attention as the foundational compute primitive whose costs drive model size, context length, and inference economics. The pla