How would you hybridize KNN with deep learning systems?

You use deep learning to generate embeddings and apply KNN on learned feature space.

Modern systems use neural networks to transform raw data into dense embeddings. KNN is then applied on these embeddings for retrieval or classification, combining representation learning with instance-based reasoning.