What is Attention Mechanism?

The core component of transformer models that allows the AI to weigh the relevance of different parts of the input when generating each output token. Self-attention enables models to understand context across long passages. Longer context windows require more attention computation, which is why prompt processing speed matters on Apple Silicon.