Latency
Domain: Evaluation
🎯 Motivation
How fast the model responds. Measured in milliseconds. Critical for user experience.
📋 Concrete Example
Latency: model takes 200ms to start responding. Users notice if it takes >1 second. Faster latency = better experience.
🔗 Analogy
A restaurant’s service speed - how long from ordering to food arriving. Faster is better. Latency is the model’s response speed.