What is learning rate scheduling?
Updated May 17, 2026
Short answer
Learning rate scheduling adjusts learning rate during training.
Deep explanation
It improves convergence by reducing learning rate over time or adapting it based on performance metrics.
Real-world example
Used in training large CNNs for better convergence.
Common mistakes
- Keeping learning rate constant for all epochs.
Follow-up questions
- What is cosine annealing?
- Why reduce learning rate?