Multi-Head Attention
Domain: NLP Fundamentals
🎯 Motivation
Runs several attention mechanisms in parallel, each focusing on different relationships, then combines results.
📋 Concrete Example
One head might focus on grammar, another on emotion, another on named entities - all at once.
🔗 Analogy
Like a team of detectives each looking at different clues (motive, alibi, evidence) and then pooling findings.