What is learning rate impact on cost function?
Updated May 15, 2026
Short answer
Learning rate controls how fast cost is minimized.
Deep explanation
Too high causes divergence; too low slows convergence. It directly affects optimization trajectory.
Real-world example
Tuning neural networks for image classification.
Common mistakes
- Using constant learning rate without tuning.
Follow-up questions
- What is adaptive learning rate?
- What happens if learning rate is zero?