ReLU
Domain: AI Fundamentals
🎯 Motivation
A simple, fast activation that keeps positives and zeroes negatives. Used in most deep networks.
📋 Concrete Example
ReLU(5) = 5, ReLU(-3) = 0. It is just max(0, x).
🔗 Analogy
Like a bouncer who lets in guests with positive vibes and turns away negative ones, no questions asked.