What is attention mechanism in Keras models?

Attention allows models to focus on relevant parts of input.

It assigns weights to input tokens or features, improving sequence modeling in NLP and vision tasks. Transformers are fully attention-based architectures.