What is learning rate warmup and why is it used in deep Keras models?

Warmup gradually increases learning rate at the start of training.

Deep networks are unstable at initialization. Warmup prevents gradient explosion by starting with a small learning rate and gradually increasing it to the target value, improving convergence stability.