What is optical flow and how is it used in deep learning vision systems?

Optical flow estimates pixel-wise motion between consecutive frames in a video.

Optical flow computes motion vectors representing displacement of pixels between frames. Classical methods use brightness constancy and spatial smoothness constraints, while deep learning methods like FlowNet and PWC-Net learn motion estimation directly from data. Optical flow is crucial for motion tracking, video segmentation, and action recognition.