Attention
Domain: AI Fundamentals
🎯 Motivation
Lets the model focus on the most relevant parts of the input when making each prediction.
📋 Concrete Example
Translating the bank of the river, attention links bank to river not to money-bank.
🔗 Analogy
Like a student skimming a long article and highlighting only the sentences relevant to the question.