juniorEnsemble Learning
What is boosting in machine learning?
Updated May 16, 2026
Short answer
Boosting is a sequential ensemble method that focuses on correcting previous model errors.
Deep explanation
Boosting trains weak learners sequentially, where each new model emphasizes samples that were misclassified by previous models. The final prediction is a weighted combination of all weak learners. This iterative correction reduces bias and improves predictive accuracy.
Real-world example
Used in credit scoring and ranking systems.
Common mistakes
- Assuming boosting models are independent like bagging.
Follow-up questions
- Why is boosting more accurate than single models?
- What is a weak learner?