Robustness Evaluation
Domain: Evaluation
🎯 Motivation
Testing how the model handles unusual inputs: typos, foreign languages, adversarial attacks, edge cases.
📋 Concrete Example
Robustness test: ‘What is 2+2?’ -> correct. ‘What iz 2+2?’ (typo) -> correct. ‘What is 2+2?’ (1000 times) -> correct. ‘What is 2+two?’ -> correct. Robust to variations.
🔗 Analogy
A car’s crash test - how does it handle unusual situations (crashes)? Robustness evaluation tests how the model handles unusual inputs.