What is checkpoint recomputation strategy in deep networks?

Checkpointing trades compute for memory by recomputing activations during backward pass.

Instead of storing all intermediate activations, only selected checkpoints are saved. During backpropagation, missing activations are recomputed, reducing memory footprint significantly.