Encoder
Domain: NLP Fundamentals
🎯 Motivation
The part of a transformer that reads and understands the input, turning it into rich representations.
📋 Concrete Example
In translation, the encoder reads the Chinese sentence and produces a set of context vectors capturing its meaning.
🔗 Analogy
Like a reader who absorbs a story and forms a deep understanding of it in their mind.