Why does PCA fail for nonlinear manifolds?

PCA only captures linear structure, not curved manifolds.

PCA projects data onto linear subspaces maximizing variance. If data lies on nonlinear structures (like Swiss rolls), PCA flattens geometry incorrectly, losing neighborhood relationships essential for learning.