Model Context
Domain: Models & Providers
Motivation
The maximum input size a model can handle. Ranges from 4K to 1M+ tokens depending on the model.
Concrete Example
GPT-4o: 128K tokens. Claude: 200K. Gemini: 1M. DeepSeek: 64K. Choose a model with enough context for your task.
Analogy
A backpack capacity - 20L vs 40L vs 100L. Choose based on how much you need to carry. Model context is the capacity for tokens.