Ablation Study
Domain: Evaluation
🎯 Motivation
Removing components one at a time to see how each contributes to performance. Like a science experiment for AI.
📋 Concrete Example
Full model: 92%. Without attention: 85% (attention contributes 7%). Without pre-training: 70% (pre-training contributes 22%). Each component’s contribution is measured.
🔗 Analogy
A recipe test - remove an ingredient and taste. Without salt: bland (salt matters). Without pepper: fine (pepper is optional). Ablation studies test each component’s importance.