How does gradient noise scale with batch size?

Gradient noise decreases as batch size increases due to better statistical estimation.

Small batches produce high variance gradient estimates, which can help exploration but slow convergence. Larger batches reduce noise but may require learning rate scaling.