What is the intuition behind Ordinary Least Squares (OLS)?

OLS finds coefficients that minimize squared vertical distances between predictions and actual values.

OLS minimizes the sum of squared residuals by projecting y onto the column space of X. The solution is the orthogonal projection that minimizes Euclidean distance in feature space.