What is spectral bias in neural networks?

Spectral bias refers to neural networks learning low-frequency functions before high-frequency ones.

Neural networks tend to prioritize smooth, low-frequency components early in training due to gradient dynamics and optimization bias.