What is the difference between contiguous and non-contiguous tensors?

Contiguous tensors store elements in a single continuous memory block; non-contiguous tensors do not.

Operations like transpose or permute create non-contiguous views using different strides. Some operations require contiguous memory and thus need .contiguous() which copies data into a new memory layout.