TF-IDF

Domain: NLP Fundamentals

🎯 Motivation

Term Frequency x Inverse Document Frequency. Highlights words that are important in a document but rare overall.

πŸ“‹ Concrete Example

The appears in every document (low IDF, ignored). Quantum might appear in one physics paper (high TF-IDF, important).

πŸ”— Analogy

Like a word’s VIP score - frequent in this document but rare elsewhere means it is a keyword.