What is Multi-Head Attention?

Multi-head attention is the parallel-attention scheme in the Transformer that runs multiple self-attention operations in parallel with different linear projections of the input, then concatenates the outputs. The platform strengthens en