Entropy
Domain: Math & Logic for AI
🎯 Motivation
Measures uncertainty or randomness. Higher entropy means more chaos, less predictability.
📋 Concrete Example
A fair coin has entropy of 1 bit. A loaded coin with 99% heads has much lower entropy.
🔗 Analogy
Like the messiness of a bedroom - a tidy room (predictable) has low entropy, a chaotic one has high.