Cost per Query
Domain: Evaluation
🎯 Motivation
How much each query costs in compute resources. Lower cost = more sustainable.
📋 Concrete Example
Cost: 1000 queries = 0.001. For 1M queries/day: $1000/day. Cost optimization matters at scale.
🔗 Analogy
The cost per meal at a restaurant - ingredients + labor + overhead per dish. Lower cost per meal = more profitable. Cost per query is the model’s cost per question.