What are memory leaks in PyTorch and how do they happen?

Memory leaks occur when tensors or computation graphs are unintentionally retained.

Common causes include storing computation graphs in lists, forgetting detach(), retaining hooks, or not freeing CUDA tensors. Autograd graph retention prevents garbage collection.