Toxicity Detection
Domain: Safety & Ethics
π― Motivation
Classifying text as toxic, severe, obscene, threatening, or insulting. Used to filter harmful content.
π Concrete Example
Model: βThis text is 85% toxic, 60% insulting, 30% threatening.β If toxicity > threshold, flag for review or block. Keeps conversations safe.
π Analogy
A smoke detector - it senses smoke (toxicity) and alarms. Toxicity detection senses harmful language and alerts the system.