Serving Infrastructure
Domain: MLOps
🎯 Motivation
The hardware and software stack that runs models in production: GPUs, servers, load balancers, APIs.
📋 Concrete Example
Infrastructure: 10 GPU servers behind a load balancer, serving API requests. Kubernetes manages pods. Prometheus monitors. Complete serving stack.
🔗 Analogy
A restaurant’s kitchen infrastructure - stoves, ovens, refrigerators, dishwashers, ventilation. The full hardware and software for cooking. Serving infrastructure runs models.