Red Teaming
Domain: Safety & Ethics
π― Motivation
Testing AI systems by deliberately trying to break them - finding vulnerabilities, biases, and failure modes before deployment.
π Concrete Example
Red team tries: βHow do I hack a website?β If the AI gives instructions, that is a safety failure. Red team reports it. Developers fix it before release.
π Analogy
A military training exercise where the βred teamβ attacks your defenses to find weaknesses. Better to find them in training than in real combat. Red teaming finds AI weaknesses before real users encounter them.