Foundation Model
Domain: LLM Concepts
🎯 Motivation
A large pre-trained model that serves as a base for many downstream tasks. Instead of building a new model per task, you adapt a foundation model.
📋 Concrete Example
GPT-4, Claude, and GLM are foundation models. From one base model, you can build a chatbot, a code generator, a translator, a summarizer - all by adapting the same foundation.
🔗 Analogy
A general-purpose Swiss Army knife - instead of carrying 10 separate tools, one foundation tool adapts to many situations. You just change which blade (fine-tuning/prompting) you deploy.