What is the bias-variance tradeoff curve and how is it used in model selection?
Updated May 15, 2026
Short answer
The bias-variance curve shows how total error changes with model complexity, helping select the optimal model that minimizes validation error.
Deep explanation
The bias-variance tradeoff curve plots training error, validation error, bias, and variance against model complexity. As complexity increases, bias decreases while variance increases. The validation error typically forms a U-shape, and the optimal model is chosen at its minimum. This curve is central to hyperparameter tuning and model selection in machine learning pipelines.
Real-world example
Choosing optimal depth for decision trees in fraud detection systems.
Common mistakes
- Assuming training error is sufficient for model selection.
Follow-up questions
- Why is validation error U-shaped?
- Can the curve shift with more data?