What is kernel fusion vs graph fusion in deep learning compilers?

Kernel fusion merges low-level GPU operations; graph fusion merges computation nodes.

Graph fusion occurs at computation graph level combining multiple ops, while kernel fusion happens at CUDA level merging instructions into a single kernel for execution efficiency.