Safety Evaluation
Domain: Evaluation
🎯 Motivation
Testing whether the model refuses harmful requests and provides safe responses across many scenarios.
📋 Concrete Example
Safety test: 1000 harmful prompts. Model refuses 985, complies with 15. Safety rate: 98.5%. The 15 failures are analyzed and fixed.
🔗 Analogy
A fire drill - testing if everyone evacuates safely. Safety evaluation tests if the model handles dangerous requests appropriately.