What is the role of residual connections in transformer depth scaling?

Residual connections preserve gradient flow in deep networks.

Residual connections allow gradients to bypass intermediate layers, preventing vanishing gradient problems. They enable training of very deep transformers by stabilizing optimization dynamics and preserving information flow across layers.