A/B Testing

Domain: MLOps

🎯 Motivation

Comparing two model versions: A (current) and B (new). Route some traffic to B, compare results, keep the winner.

A/B test: 90% of users get model A, 10% get model B. B has 3% higher satisfaction. Promote B to 100%. Data-driven decisions.

A taste test at a restaurant - 90% of customers get the old recipe, 10% get the new one. If the new one is preferred, switch entirely.