Causal Language Modeling
Domain: NLP Fundamentals
🎯 Motivation
Predicts the next token given all previous tokens. How GPT models are trained.
📋 Concrete Example
Given The cat sat on the, predict mat. The model can only look left, never right.
🔗 Analogy
Like writing a story one word at a time - you can only use what you have already written.