What is the relationship between PCA and factor analysis?

PCA focuses on variance maximization, while factor analysis models latent variables causing correlations.

PCA is a mathematical transformation technique, while factor analysis assumes an underlying probabilistic model explaining observed variables. PCA is deterministic, whereas factor analysis is probabilistic and includes error modeling.