How does feature sparsity affect KNN performance?

Sparse high-dimensional features reduce the effectiveness of distance metrics in KNN.

In sparse spaces, most vectors are orthogonal or equally distant, making it difficult to distinguish nearest neighbors. This reduces KNN’s discriminative power significantly.