What is the role of linear algebra in deep learning optimization?

It defines how gradients, weights, and updates interact in high-dimensional space.

Training deep networks involves vectorized gradient computation, matrix multiplications, and Jacobian/Hessian structures. Optimization is movement in vector spaces guided by gradients.