What is Neural Tangent Kernel (NTK)?

NTK describes neural networks as kernel machines in infinite-width limit.

As width approaches infinity, neural networks behave like linear models in function space, enabling theoretical analysis of training dynamics.