Self-Attention
Domain: NLP Fundamentals
🎯 Motivation
Each token looks at all other tokens in the same sequence to understand its own meaning in context.
📋 Concrete Example
In The bark was loud, self-attention helps the model know bark means dog sound (not tree bark) by looking at loud.
🔗 Analogy
Like a group discussion where each person listens to everyone else to decide what they themselves mean.