What is graph re-compilation overhead in dynamic shape models?

Dynamic shapes trigger recompilation, adding overhead in torch.compile pipelines.

When input shapes change beyond guard constraints, TorchDynamo must re-capture and recompile the graph. This introduces latency spikes but allows flexibility in real-world variable-length inputs.