Prompt Testing
Domain: Prompt Engineering
🎯 Motivation
Systematically testing prompts with various inputs to ensure they work reliably across edge cases, not just happy paths.
📋 Concrete Example
Test ‘Classify sentiment: [text]’ with: clearly positive, clearly negative, neutral, mixed, sarcastic, empty, very long. If it fails on sarcasm, add sarcastic examples to the prompt.
🔗 Analogy
Stress-testing a bridge - you don’t just test with a car (happy path); you test with heavy trucks, high winds, and earthquakes (edge cases). Prompt testing does this with diverse inputs.