Layer
Domain: LLM Concepts
🎯 Motivation
A transformer has multiple layers stacked on top of each other. Each layer processes the text and passes its understanding to the next layer.
📋 Concrete Example
A 96-layer transformer: Layer 1 detects basic patterns (word boundaries). Layer 12 captures syntax. Layer 48 understands sentences. Layer 96 reasons about the whole passage.
🔗 Analogy
A factory assembly line with 96 stations - each station adds something. Station 1 puts on the frame, station 50 installs electronics, station 96 does final inspection. Each layer refines the understanding.