Streaming Response
Domain: LLM Concepts
🎯 Motivation
Instead of waiting for the entire response to be generated, streaming sends tokens as they’re produced, so the user sees text appearing in real-time.
📋 Concrete Example
When ChatGPT types out its answer word by word - that’s streaming. Without it, you’d stare at a blank screen for 10 seconds, then see the whole answer at once.
🔗 Analogy
A live sports broadcast vs a recording - live (streaming) shows the action as it happens. A recording shows everything at once after it’s done. Streaming feels faster and more engaging.