Decoder

Domain: NLP Fundamentals

🎯 Motivation

The part of a transformer that generates the output sequence one token at a time, using encoder context.

📋 Concrete Example

In translation, the decoder generates the English translation word by word, guided by the encoder output.

🔗 Analogy

Like a writer who takes the understanding and writes it out in a new language, one word at a time.