Why does sample complexity increase in high dimensions?
Updated May 15, 2026
Short answer
More data is needed to cover expanded feature space.
Deep explanation
To maintain statistical reliability, sample size must grow exponentially with dimensions.
Real-world example
Training deep learning models with limited datasets.
Common mistakes
- Assuming linear data growth is enough.
Follow-up questions
- What is PAC learning?
- How to reduce need for data?