Attention Mechanism
Domain: NLP Fundamentals
🎯 Motivation
Lets the model focus on the most relevant input words when producing each output word.
📋 Concrete Example
Translating The bank of the river, attention links bank to river (not to money-bank) to translate correctly.
🔗 Analogy
Like a student highlighting key sentences in a textbook before answering a question.