What is stochastic depth in deep vision architectures?

Stochastic depth randomly drops entire residual blocks during training to improve generalization.

Stochastic depth randomly skips residual blocks during training with a certain probability, effectively training an ensemble of networks of varying depth. This improves gradient flow, reduces overfitting, and allows very deep networks to train more effectively without degradation.