Model Serving

Domain: MLOps

🎯 Motivation

Running a model so it can process requests. Can be local, cloud, or edge.

📋 Concrete Example

Serving options: 1) Local: model on your laptop. 2) Cloud: model on AWS/GCP. 3) Edge: model on a phone. Each has different speed, cost, and privacy trade-offs.

🔗 Analogy

A food truck vs a restaurant vs a vending machine - different ways to serve food (model). Food truck (cloud), restaurant (local server), vending machine (edge). Each serves differently.