Context Length
Domain: NLP Fundamentals
🎯 Motivation
How many tokens of conversation the model remembers at once. Beyond this, old messages are forgotten.
📋 Concrete Example
If context length is 4096 tokens and the chat exceeds that, the earliest messages drop out of memory.
🔗 Analogy
Like a goldfish bowl - there is only so much room. New water pushes old water out.