How does Residual Connection work?

Mathematically, the output of each sublayer becomes y = LayerNorm(x + Sublayer(x)) — the addition of the original input is what makes the connection "residual". Residual connections enable training of very deep networks (hundreds of layers) by providing direct gradient paths that prevent vanishing and exploding gradients during backpropagation. The platform strengthen