What is lazy tensor initialization in PyTorch models?

Lazy initialization defers parameter shape creation until first forward pass.

Lazy modules (e.g., LazyLinear) infer input feature dimensions at runtime. This avoids manual shape specification and is useful in dynamic architectures. Parameters are initialized on first forward call using actual input tensor shapes.