What is vanishing gradient problem?

Vanishing gradients occur when gradients become too small in deep networks.

In deep layers, gradients shrink during backpropagation, preventing effective learning in early layers.