KL Divergence
Domain: Math & Logic for AI
🎯 Motivation
Measures how one probability distribution differs from another. Not symmetric - direction matters.
📋 Concrete Example
Compare a predicted word distribution to the true one. KL divergence quantifies the gap.
🔗 Analogy
Like measuring how different your map is from the real city layout - useful for knowing how much to correct.