Can KNN be interpreted as a form of local function approximation?

Yes, KNN approximates the target function locally using nearby samples.

KNN assumes that the function mapping inputs to outputs is locally smooth. It approximates this function using constant or simple estimators within a neighborhood, effectively performing non-parametric regression or classification.