Version Comparison
Domain: Evaluation
🎯 Motivation
Comparing model versions to ensure new versions are better, not just different.
📋 Concrete Example
v1: 85% accuracy, 2s latency. v2: 88% accuracy, 1.5s latency. v2 is better. v3: 90% accuracy, 3s latency. v3 is more accurate but slower. Trade-offs must be evaluated.
🔗 Analogy
Comparing phone models - iPhone 15 vs 16: better camera, faster chip, but shorter battery. Version comparison weighs pros and cons of each model version.