What is gradient accumulation and why is it used in Keras training?

Gradient accumulation simulates large batch training by accumulating gradients over multiple steps.

It allows training large models on limited GPU memory by splitting batches into micro-batches. Gradients are accumulated before optimizer step, effectively increasing batch size without increasing memory usage.